Logo Haohan's Blog
  • Home
  • About
  • Education
  • Experiences
  • Projects
  • More
    Skills Featured Posts Recent Posts Accomplishments
  • Posts
  • Notes
  • English
    English 简体中文
  • Dark Theme
    Light Theme Dark Theme System Theme
Logo Inverted Logo
  • Posts
  • Examples
    • Introduction
    • Category
      • Sub-Category
        • Rich Content
    • Markdown Sample
    • Shortcodes Sample
  • Deep Learning (Pytorch)
    • Chapter 2 Preparation
    • Chapter 3 Linear Regression
    • Chapter 4 Multilayer Perceptrons
  • Quant
    • Multi-Factors Model
      • Performance Attribution
  • Linear Models
    • Linear Regression
    • Linear Regression and Stats
    • Linear Regression in Quant
      • Conceptions
      • Assumptions
      • Coefficients
      • R Square
      • R Square and Corr
  • Matrix Cookbook
    • Matrix Basic
      • Notations
      • Basics
  • Tips
    • Ubuntu
      • Easyconnect
    • SFTP
    • Vscode remote ssh
Hero Image
Questions of R Square and Corr Coef

$y\sim(1,\boldsymbol{x})$, regress $y$ on $x$ with intercept. $y\sim(\boldsymbol{x})$, regress $y$ on $x$ without intercept. In the context of Statistics, SSE (Sum of Squares due to Error) and SSR (Sum of Squares due to Regression) are used more frequently. But in Economitrics, ESS (Explained Sum of Squares) and RSS (Residual Sum of Squares) are prefered. 0.1 Bivariate Regression Denote the $R^2$ of $y\sim(1,x_1)$ as $R_1^2$, $y\sim(1,x_2)$ as $R_2^2$, $y\sim(1,x_1,x_2)$ as $R_3^2$. And we have $corr(x_1,x_2)=\rho$.

  • Linear Model
  • Linear Regression
  • Quant
Tuesday, November 26, 2024 | 3 minutes Read
Hero Image
Questions of R Square

$y\sim(1,\boldsymbol{x})$, regress $y$ on $x$ with intercept. $y\sim(\boldsymbol{x})$, regress $y$ on $x$ without intercept. In the context of Statistics, SSE (Sum of Squares due to Error) and SSR (Sum of Squares due to Regression) are used more frequently. But in Economitrics, ESS (Explained Sum of Squares) and RSS (Residual Sum of Squares) are prefered. 0.1 Definition $$ R^2 = \frac{SSR}{SST} = \frac{||\hat{Y} - \overline{Y}||^2}{||Y - \overline{Y}||^2} = 1 - \frac{SSE}{SST} = 1 - \frac{||\hat{\epsilon}||^2}{||Y - \overline{Y}||^2} $$

  • Linear Model
  • Linear Regression
  • Quant
Tuesday, November 26, 2024 | 3 minutes Read
Hero Image
Questions of Assumptions

$y\sim(1,\boldsymbol{x})$, regress $y$ on $x$ with intercept. $y\sim(\boldsymbol{x})$, regress $y$ on $x$ without intercept. In the context of Statistics, SSE (Sum of Squares due to Error) and SSR (Sum of Squares due to Regression) are used more frequently. But in Economitrics, ESS (Explained Sum of Squares) and RSS (Residual Sum of Squares) are prefered. 0.1 Heteroskedasticity and Autocorrelation If the residuals ($\epsilon$) in a linear regression model exhibit heteroskedasticity (non-constant variance) or autocorrelation (correlation between residuals across observations), how will it impact the estimation and inference of $\beta$? How to test and solve these problems?

  • Linear Model
  • Linear Regression
  • Quant
Tuesday, November 26, 2024 | 7 minutes Read
Hero Image
Questions of Coefficients

$y\sim(1,\boldsymbol{x})$, regress $y$ on $x$ with intercept. $y\sim(\boldsymbol{x})$, regress $y$ on $x$ without intercept. In the context of Statistics, SSE (Sum of Squares due to Error) and SSR (Sum of Squares due to Regression) are used more frequently. But in Economitrics, ESS (Explained Sum of Squares) and RSS (Residual Sum of Squares) are prefered. 0.1 Product of $\beta$ Denote $\beta_1$ as the least squares optimal solution of $y=\beta x+\epsilon$, $\beta_2$ as the least squares optimal solution of $x=\beta y+\epsilon$. Find the min and max values of $\beta_1\beta_2$. $$ \beta_1 = \frac{Cov(X,Y)}{Var(X)},\quad \beta_2 = \frac{Cov(X,Y)}{Var(Y)}\Rightarrow \beta_1\beta_2 = \rho_{XY}^2 \in [-1,1] $$

  • Linear Model
  • Linear Regression
  • Quant
Saturday, November 16, 2024 | 4 minutes Read
Hero Image
Questions of Conceptions

With reference to donggua. I complete the answers of these questions. 0.1 Notations $y\sim(1,\boldsymbol{x})$, regress $y$ on $x$ with intercept. $y\sim(\boldsymbol{x})$, regress $y$ on $x$ without intercept. In the context of Statistics, SSE (Sum of Squares due to Error) and SSR (Sum of Squares due to Regression) are used more frequently. But in Economitrics, ESS (Explained Sum of Squares) and RSS (Residual Sum of Squares) are prefered. 0.2 Conceptions and Basic Definitions 0.2.1. The assumptions of LR Gauss-Markov Theory: Under the assumptions of classical linear regression, the ordinary least squares (OLS) estimator is the linear unviased estimator with the minimum variance. (BLUE)

  • Linear Model
  • Linear Regression
  • Quant
Saturday, November 16, 2024 | 5 minutes Read
Navigation
  • About
  • Education
  • Experiences
  • Projects
  • Skills
  • Featured Posts
  • Recent Posts
  • Accomplishments
Contact me:
  • zhhohoh27@gamil.com
  • online727
  • Haohan Zhao
  • +86 19551998168

Liability Notice: This site is built on hugo and github pages and uses the hugo-toha theme. The site is used for personal blogging, all content is owned by me and does not constitute any relevant advice, if you have any questions, please contact me!


Toha Theme Logo Toha
© 2020 Copyright.
Powered by Hugo Logo