Binary Logistic Regression Analysis
1. Logistic Regression
When the dependent variable is binary coded (eg. success vs failure), using simple linear regression to model the outcome variable may not be suitable. Instead of using linear regression, one can consider binary logistic regression instead.
2. The general notation of a logistic regression model
ln(p/q) = B0 + B1x + u
Where,
- ln(p/q) is the dependent variable
- x is the independent variable
- B0 is the intercept
- B1 is the slope
3. Parameter estimation in logistic regression
Unlike linear regression, ordinary least square method may not be appropriate in determining the parameters in the logistc regression. For logistic regression, a likelihood function can be form and the parameters can be determined through maximum likelihood method and solve for the parameters using gradient descent.
Question
Determine the cofficient for the independent variable for the following datasets.
Question 1
| DV1 | IV1 |
| 0 | 6 |
| 1 | 7 |
| 1 | 2 |
| 0 | 8 |
| 1 | 6 |
| 0 | 2 |
| 1 | 3 |
| 0 | 8 |
| 1 | 5 |
| 0 | 2 |
| 0 | 8 |
| 1 | 10 |
| 1 | 2 |
| 0 | 5 |
| 0 | 8 |
| 0 | 4 |
| 1 | 8 |
| 1 | 7 |
| 1 | 1 |
| 1 | 8 |
| 1 | 2 |
Question 2
| DV2 | IV2 |
| 1 | 10 |
| 0 | 7 |
| 1 | 8 |
| 0 | 9 |
| 1 | 1 |
| 0 | 8 |
| 0 | 8 |
| 0 | 9 |
| 0 | 5 |
| 0 | 1 |
| 0 | 8 |
| 1 | 4 |
| 0 | 1 |
| 1 | 10 |
| 1 | 2 |
| 0 | 8 |
| 0 | 4 |
| 0 | 1 |
| 1 | 1 |
| 1 | 10 |
| 1 | 4 |
Question 3
| DV3 | IV3 |
| 0 | 2 |
| 1 | 6 |
| 0 | 2 |
| 1 | 8 |
| 1 | 5 |
| 1 | 5 |
| 1 | 9 |
| 0 | 5 |
| 1 | 6 |
| 0 | 10 |
| 0 | 5 |
| 1 | 8 |
| 0 | 9 |
| 1 | 9 |
| 1 | 8 |
| 1 | 4 |
| 1 | 3 |
| 1 | 8 |
| 0 | 4 |
| 1 | 3 |
| 1 | 3 |
Question 4
| DV4 | IV4 |
| 0 | 6 |
| 1 | 3 |
| 0 | 9 |
| 1 | 4 |
| 1 | 9 |
| 0 | 9 |
| 1 | 10 |
| 0 | 4 |
| 1 | 5 |
| 1 | 3 |
| 1 | 1 |
| 1 | 7 |
| 1 | 9 |
| 0 | 9 |
| 1 | 4 |
| 1 | 1 |
| 1 | 10 |
| 0 | 6 |
| 0 | 8 |
| 0 | 2 |
| 1 | 9 |
Question 5
| DV5 | IV5 |
| 1 | 1 |
| 1 | 4 |
| 0 | 4 |
| 0 | 3 |
| 0 | 9 |
| 0 | 7 |
| 0 | 5 |
| 0 | 3 |
| 1 | 1 |
| 0 | 6 |
| 0 | 6 |
| 0 | 5 |
| 1 | 7 |
| 0 | 10 |
| 0 | 8 |
| 0 | 3 |
| 1 | 6 |
| 0 | 4 |
| 1 | 7 |
| 0 | 9 |
| 1 | 7 |
Question 6
| DV6 | IV6 |
| 0 | 3 |
| 0 | 7 |
| 1 | 7 |
| 1 | 8 |
| 1 | 5 |
| 1 | 1 |
| 1 | 2 |
| 1 | 5 |
| 1 | 4 |
| 0 | 6 |
| 1 | 9 |
| 0 | 2 |
| 0 | 9 |
| 1 | 8 |
| 1 | 4 |
| 1 | 7 |
| 0 | 9 |
| 1 | 9 |
| 0 | 6 |
| 1 | 5 |
| 1 | 6 |
Answer
- -0.0809
- -0.0171
- 0.1301
- -0.0977
- -0.195
- -0.0491
Notes: There are other useful information can be determined when performing logistic regression analysis such as the Nagelkerke R-squared.
About the Math Tutor - Dr Loo
I am a PhD holder with 9 years of teaching experience at secondary school and university. My expertizes are mathematics, statistics, econometrics, finance and machine learning.
Currently I do provide consultation and private tuition in Singapore. For those who are looking for math tutor in Singapore or statistics tutor in Singapore, please feel free to contact me at +65-85483705 (SMS/Whatsapp/Telegram).
Some of the math tuition in Singapore I provide includes O-level math tuition and also JC Math Tuition (H1 Math Tuition & H2 Math Tuition). On the other hand, my statistics tuition in Singapore mostly focus on pre-university level until postgraduate level. For those who prefer online tutoring service, the online O-level math tuition and online JC math tuition are also available.
For those who are looking for math tution in Singapore
Need help with this topic? I do provide mathematics home tuition in Singapore for O-level math and also JC H2 math. In addition, online math tutoring is available as well. Feel free to contact me if you would like to know further.
