Assignment 3 of Webbook about Linear Regression from UCLA ATS

coming soon~~~~~~

Convert Categorical Variable to Dummy Variables (Indicators)

说明：
假如变量School有1000个观测值，其中unique的观测值有50个，也就是有50个不同的学校。在linear regression中要把School这个变量变成50个dummy ariable才可以（实际用49个，因为有一个是reference）。怎么做？一个SAS Macro如下：

%macro DUMMY ( dsn = ,

var = ,

prefix = ) ;

proc summary data = &dsn nway ;

class &var ;

output out = x ( keep = &var ) ;

proc print ;

*;

data _null_ ;

set x nobs=last ;

if _n_ = 1 then call symput ( 'num',

trim(left(put( last, best. ) ) ) ) ;

call symput ( 'c' || trim ( left (

put ( _n_, best. ) ) ),trim ( left

( &var ) ) ) ;

run ;

data &dsn ;

set &dsn nobs=last;

array ct ( &num ) %do k=1 %to

&num ;

&prefix&&c&k

%end ; ;

%do i = 1 %to &num ;

select;

when (&var="&&c&i" ) ct(&i)=1;

otherwise ct(&i)=0;

end;

%end;

run ;

%mend Dummy ;

%Dummy ( dsn = name , var = name,

prefix = sic_ ) ;

proc print ;

run;

quit;

说明：

1：第一步proc summary产生dataset X。X是原data dsn中var的unique的值。所以这一步可以用 proc sort noduplicate来得到；

2： 第二步_null_产生两个macro variable，第一个是&num，是原data dsn中var的unique值的size，也就是X的size，记为&num；第二个macro variable是一系列macro variable，从&&c&1到&&c&num。也就是把X的变量的每一个值赋给对应的&&c&i；

3：来产生dummy variable。总共有&num个dummy variable，所以建立一个array，有&num列，叫ct(&1) 到 ct(&num)，对应的变量名为&prefix&&c&k。然后就是比较。从dsn中读进来的var的每个值，跟相应的&&c&i比较，相同为1，否则为0.最终得到所要的东西。

更直接一点，源程序分解：

data name;

      input name $;

      cards;

      zhao

      qian

      sun

      li

      zou

      wu

      zeng

      wang

      zhao

      wang

      sun

      wu

      ;

run;

proc summary data = name nway ;

class name;

output out = x ( keep = name ) ;

proc print ;

data _null_ ;

set x nobs=last ;

if _n_ = 1 then call symput ( 'num',

trim(left(put( last, best. ) ) ) ) ;

call symput ( 'c' || trim ( left (

put ( _n_, best. ) ) ),trim ( left

( name ) ) ) ;

run ;

%put #

%put &c1;

%put &c2;

%put &c3;

%put &c4;

%put &c5;

%put &c6;

%put &c7;

%put &c8;

Symbols in SAS Scatter Plot zz from ucla ats

There are many other symbols available from SAS.  To use these, you need to specify a specific font. SAS fonts that contain special symbols include:

• CARTOG
• SPECIAL
• ELECTRON
• MATH
• WEATHER
• MUSIC
• MARKER

We can use SAS proc gfont to see the symbols and the corresponding character codes.  The character codes are the letters on the keyboard that are associated with a particular symbol.  In the example below, a left-pointing triangle is the symbol and the capital letter A is the character code.  The program below can be used to see what symbols that font called Marker has.

goptions reset = all ctext = blue htext = 6pct ftext = swissb ;
title "Special symbols with the Marker font";
proc gfont name = marker ctext = red showroman nobuild;
run;

Linear Regression with Categorical Predictors and Its interaction

Linear Regression with Categorical Predictors and Its interactions

The data set we use is elemapi2; variable mealcat is the percentage of free meals in 3 categories (mealcat=1, 2, 3); collcat is three different collections. They are both categorical variables.

1: Regression with only one categorical predictors

Since mealcat is categorical, we transfer it to dummy variables for linear regression. That it, mealcat1=1 if mealcat=1, else mealcat1=0; mealcat2=1 if mealcat=2 else mealcat2=0; mealcat3=1 if mealcat=3 else mealcat3=0;

The regression of api00~mealcat2 mealcat3 is (mealcat1 is as reference):

proc reg data=elemdum;

       model api00 = mealcat2  mealcat3;

       plot predicted.*mealcat;

run;

The output is:

The intercept is 805.72; Since mealcat=1 is reference group, that is:

mean of api00 at mealcat=1 is 805.72;

the coefficient for mealcat2 is the difference between mealcat=2 and mealcat=1;

Mean of api00 at mealcat=2 is 805.72-166.32=639.40;

The coefficient for mealcat3 is the difference between mealcat=3 and mealcat=1;

Mean of api00 at mealcat=3 is 805.72-301.34=504.38.

The result can be verified by:

proc means data=elemdum;

       var api00;

       class mealcat;

run;

mealcat	1	2	3
mean of api00	805.72	639.4	504.38

It is the same as anova result.

Since in proc glm the last category is automatically chosen as reference, it shows the same information as above.

2: Regression with two Categorical Variables

1)      here we consider there are two categorical variables, mealcat and collcat. The regression is:

proc reg data=elemdum;

       model api00 = mealcat1  mealcat2 collcat1 collcat2 ;

run;

quit;

Look at the following graph:

With respect wot mealcat, mealcat=3 is the reference; with respect to collcat, collcat=3 is the reference. So cell 9 is the reference cell, and intercept is the predicted value for this cell.

The coefficient for mealcat2 if the difference between cell 8 and cell 9; it’s also the difference between cell 5 and cell 6, and the difference between cell 2 and cell 3; in the same way we can explain mealcat1.

The coefficient for collcat2 is the difference between cell 6 and cell 9; it’s also the difference between cell 5 and cell 8, and the difference between cell 4 and cell 7; in the same way we can explain collcat1.

But if you calculate the mean for each cell, it will be different from the predicted value here. Why? Because here we only have main effect, therefore we have restrictions that the difference for some cells are the same as stated above.

2)      Next we can use anova to get the same result:

proc glm data=elemdum;

       class mealcat collcat;

       model api00 = mealcat collcat / solution ss3;

run;

The result is the same as we use dummy variables.

3: Regression with Interactions of Categorical Variables

1)      As is shown above, it’s assumed that the differences of some cells are the same. To remove this restriction, now we consider interactions of the two categorical variables.

First we need to create the dummy interactions, that is, the interaction of variable mealcat and collcat. SAS code is:

data elemdum;

       set sasreg.elemapi2 (keep=api00 some_col mealcat collcat);

       array mealdum(3) mealcat1-mealcat3;

       array colldum(3) collcat1-collcat3;

       array mxc(3,3) m1xc1-m1xc3 m2xc1-m2xc3 m3xc1-m3xc3 ;

       do i=1 to 3;

              do j=1 to 3;

                     mealdum(i)=(mealcat=i);

                     colldum(j)=(collcat=j);

                     mxc(i,j)=mealdum(i)*colldum(j);

              end;

       end;

       drop i j;

run;

We can check the indicators by proc freq in SAS:

proc freq data=elemdum;

       table mealcat*collcat * m1xc1*m1xc2*m1xc3*m2xc1*m2xc2*m2xc3*m3xc1*m3xc2*m3xc3 / nopercent nocum list;

run;

The option list displays two-way to n-way tables in a list format rather than as crosstabulation tables.

Now we will add the dummy variables and interactions into the regression. We also set mealcat=3 and collcat=3 as reference.

proc reg data=elemdum;

       model api00 = mealcat1 mealcat2 mealcat3 collcat1 collcat2 collcat3 m1xc1--m3xc3;

run;

The output is:

From the output we can see:

a: some variables has no coefficient estimation since they are at reference level;

b: interaction m2xc1 and m2xc2 is not sifnificant.

One important thing is what does the interaction mean? In the case without interaction, the coefficient Bmealcat1 means the difference between group mealcat=1 and the reference group mealcat=3. Here with interactions, it’s more complicated. The presence of interaction imply that the difference of mealcat=1 and mealcat=3 depends on the level of collcat. For example, the interaction term Bm1xc1 means the extent to which the difference between mealcat=1 and mealcat=3 changes when collcat=1 compared to collcat=3. That is, Bm1xc1=(c1-c7)-(c3-c9).

To be more detailed, I will list the items in each cell as below:

So, if you want to perform a test of the main effect of collcat=1 and collcat=3 when mealcat=1, you need to compare (Intercept + Bmealcat1+ Bcollcat1 + Bm1xc1) - (Intercept + Bmealcat1) = Bcollcat1 + Bm1xc1 is zero or not. That is:

The test is significant, indicating that collcat at level 1 and 3 is significant for the mealcat=1 group.

2)      The same result can be given by anova as below:

proc glm data = elemdum;

       class mealcat collcat;

       model api00 = mealcat collcat mealcat*collcat / solution;

       lsmeans mealcat*collcat / slice=collcat;

run;

At last, we can verify our result by calculating the average of each cell by proc tabulate:

Or we can get it by proc sql from SAS:

proc sql;

       create table temp as

       select mean(api00) as avg, collcat, mealcat

       from elemdum

       group by mealcat, collcat

       order by mealcat, collcat;

run;

quit;