Need an updated web spider scraping program written for the following FRE7722
Budget: $30 – $250 USD
I need a web scraper written for the following url:
http://www.freight-tec.wooie.com/Loads
All of the information needed is available on the main page; the number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "Origin City, ST" column, data located before the comma
origin_state --> data is located in the "Origin City, ST" column, data located after the comma
ship_date --> data is located in the "Pickup" column, changed to the YYYY-MM-DD format
destination_city --> data is located in the "Destination City, ST" column, data located before the comma
destination_state --> data is located in the "Destination City, ST" column, data located after the comma
receive_date --> leave blank
trailer_type --> data is located in the "Truck Type" column
load_size --> add text "full" to the column
weight --> leave blank
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> leave blank
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> data located in the "Contact" column
load_number --> leave blank
commodity --> leave blank
The first line of the output should contain all of the column headers.
Any field that contain no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'FRE7722.pl' and the output file should be
called 'FRE7722.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
We suggest WWW::Mechanize but you are free to use other Perl libraries.
Please specific what language/OS/tools you will be using in your bid.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
http://www.freight-tec.wooie.com/Loads
All of the information needed is available on the main page; the number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "Origin City, ST" column, data located before the comma
origin_state --> data is located in the "Origin City, ST" column, data located after the comma
ship_date --> data is located in the "Pickup" column, changed to the YYYY-MM-DD format
destination_city --> data is located in the "Destination City, ST" column, data located before the comma
destination_state --> data is located in the "Destination City, ST" column, data located after the comma
receive_date --> leave blank
trailer_type --> data is located in the "Truck Type" column
load_size --> add text "full" to the column
weight --> leave blank
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> leave blank
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> data located in the "Contact" column
load_number --> leave blank
commodity --> leave blank
The first line of the output should contain all of the column headers.
Any field that contain no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'FRE7722.pl' and the output file should be
called 'FRE7722.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
We suggest WWW::Mechanize but you are free to use other Perl libraries.
Please specific what language/OS/tools you will be using in your bid.
Also, please include the word "raccoon" in your bid so I know that
you read this description.