Lab46 Wiki

The purpose here is to mine the 2012 spring class schedule in html format and extract specific classes

• Knowledge of Regular Expressions
• Knowledge of Shell Scripting

• With this I will be saving the relevant data to a file and manipulating the file via a shell script.

• To get the dataz

  * cat spring2012-20111103.html | grep "ddtitle" | sed 's/^<TH CLASS="ddtitle".*crn_in=.....">//g' | sed 's/<\/A.*$//g' | sed 's/^\(.*\) - \([0-9][0-9][0-9][0-9][0-9]\) - \(.*\) - \([0-9][0-9][0-9]\)$/\1: \3-\4:\2/g'

• Shell Script

#!/bin/bash

echo -n "please enter a class: "

read class

cat combooutput1 | grep -A5 $class

• Files and directories
• Commands
• The UNIX shell
• Regular Expressions
• Filters
• Scripting
• The UNIX development Environment

• This was relatively easy working with only the necessary data.