V.

Motiniva found that selecting subset for a state out of schdata was taking a long time in R. Here is an awk script that does it in no time. This script will create a text file which can then be read into R.

Save the following script in a file. Make the file executable (chmod +x filename). Edit the file to change the output file name (in two places) and the name of the State. Run it (./filename).

##awk script starts here
cp /nfs/data/Education/”Seventh AISES”/flash/schdata.txt .
awk ‘
BEGIN { FS=”:”
OFS=”:”}
BEGIN { print (“STCODE”,”STNAME”,”DISTCODE”,”DISTNAME”,”TCODE”,”BLOCKCODE”,”BLOCKNAME”,”VILCODE”,”VILNAME”,”WCODE”,”SCHCODE”,”SCHNAME”,”SCHADD”,”AREA”,”SCHCAT”,”SCHBULD”,”FTMALE”,”FTFEMALE”,”PMALE”,”PFEMALE”,”PTMALE”,”PTFEMALE”,”EB1″,”EB2″,”EB3″,”EB4″,”EB5″,”EB6″,”EB7″,”EB8″,”EB9″,”EB10″,”EB11″,”EB12″,”EG1″,”EG2″,”EG3″,”EG4″,”EG5″,”EG6″,”EG7″,”EG8″,”EG9″,”EG10″,”EG11″,”EG12″,”TOT1″,”TOT2″,”TOT3″,”TOT4″,”TOT5″,”TOT6″,”TOT7″,”TOT8″,”TOT9″,”TOT10″,”TOT11″,”TOT12″,”TOTB”,”TOTG”,”TOTSCH”) > “orissa.csv”}
$2 == “Orissa” {print ($0) >> “orissa.csv”}
‘ schdata.txt
rm schdata.txt
##awk script ends here.

To read the output data into R, use

read.table(“filename”,sep=”:”)->statedata

V.

My daughter’s school is closed this week. I have to arrange for
somebody to baby-sit while I take the class. I will try to come in
time but if I am wait, please do wait. Go through the recent posts on
http://vikasrawal.wordpress.com and start working on the assignment
data while you are waiting for me.

Also for the same reason, can we keep tomorrow’s (Friday) class at
11.15 am?

Sorry for this.

V.

The manual dealing with import/export of data to/from R is here. Please go through this to seek guidance on importing data into R. I hope all of you have subscribed to r-help mailing list. Go through the archives of the list for specific problems not discussed in the manual. Any problems that still remain, discuss in the class or see me in my office.

V.

The school education survey data are in a large dbf file called “schdata.dbf” in the following location /nfs/data/Education/Seventh AISES/flash

A simple function to read dbf files into is available as part of the package foreign. foreign has been installed as part of the r installation on cespserv. Note that it may not be installed on each client terminal in the computer centre. If it is not installed on your machine, you can run R on cespserv as follows and use the library(foreign).

> ssh -X username@cespserv

Enter your password when prompted. This will take you to the terminal prompt of the server. (The prompt will not change to “username@cespserv:~$”).

Type R here to start R.

library (foreign) #this will invoke package foreign

?read.dbf #this will open the help page

# the following command should read the dbf file and create schdata

#dataframe.

read.dbf(“/nfs/data/Education/”Seventh AISES”/flash/schdata.dbf”, as.is=T)->schdata

If you want to go back and do rest of the work on your own machine’s R installation, quit and save the workspace. Exit from the server and start R in your own machine. schdata should reappear. Otherwise, it is just fine to do all the work on the server’s R.

V.

I want to start the workshop sessions on R simultaneously. It will be useful if people look at my course website and start going through the “Introductory texts”.

Also, I hope all of you have looked at the School Education Survey data. I want to get you started on the assignment in the next class.

V.