Freelance Project

All freelance projects at One Location


eng_468x60_peopleflag  eng_468x60_step

Data Grab Script 02.12.08


i need to harvest this db http://webprod.cio.sc.gov/SCVendorSearch/vendorSearch.do

Do a wildcard search on any state
click resulting company link

I need all data from each tab (company, contact, emergency, commodities) in a single row with column headings (csv).

Commodity will be tricky since there are multiple commodities per contact. I’m open to suggestions here.

I will need to sort resulting csv by commodity to select the contacts I need.

Possibilities…
A. 2 phase grab
-Grab all commodities
-I select the commodities I want contacts for and provide list
-Regrab contacts searching only for targeted commodities

B. Multiple records
-Grab all contacts
-create additional record (per contact) per each commodity
ex. contact1, commodity1
contact1, commodity2
contact1, commodity3

Open to other suggestions for quickest, simplest method for script. I can sort and further refine data in excel once I have the raw data.

I’ll need contacts for all states available.

  • Digg
  • Sphinn
  • FriendFeed
  • del.icio.us
  • Facebook
  • Mixx
  • Google Bookmarks
  • LinkedIn
  • StumbleUpon
  • Yahoo! Buzz


If you enjoyed this post, make sure you
Subscribe to my RSS feed!


  • Freelance Arena
  • Unique Premium WordPress Themes
  • teliad - the marketplace for text links