Need a web spider scraping program written for the following username DFUSER576
Budget: $30 – $250 USD
I need a web scraper written for the following url:
https://www.directfreight.com/emails/UV3H7Q7X7CHJHP72N/text-html2
All information needed is available on the main page. The number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "START" column before the two letter state abbreviation
origin_state --> data is located in the "START" column after the origin_city, data is the two letter state abbreviation
ship_date --> add the current days date, change to the YYYY-MM-DD format
destination_city --> data is located in the "END" column before the two letter state abbreviation, if multiple city and states are listed, use the data listed last and add the text "Mult Stops" in the "comment" column
destination_state --> data is located in the "END" column after the destination_city, data is the two letter state abbreviation, if multiple city and states are listed, use the data listed last and add the text "Mult Stops" in the "comment" column
receive_date --> leave blank
trailer_type --> data is located in the "TRAILER" column
load_size --> add text "Full"
weight --> data is located in the "WEIGHT" column, only the numbers the # sign is not needed
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> data located in the "RATE" column
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> see notes on destination_city and destination_state columns
load_number --> data is located in the "ORDER #" column
commodity --> data is located in the "COMMODITY" column
The first line of the output should contain all of the column headers.
Any field that contains no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'DFUSER576.pl' and the output file should be
called 'DFUSER576.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
https://www.directfreight.com/emails/UV3H7Q7X7CHJHP72N/text-html2
All information needed is available on the main page. The number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "START" column before the two letter state abbreviation
origin_state --> data is located in the "START" column after the origin_city, data is the two letter state abbreviation
ship_date --> add the current days date, change to the YYYY-MM-DD format
destination_city --> data is located in the "END" column before the two letter state abbreviation, if multiple city and states are listed, use the data listed last and add the text "Mult Stops" in the "comment" column
destination_state --> data is located in the "END" column after the destination_city, data is the two letter state abbreviation, if multiple city and states are listed, use the data listed last and add the text "Mult Stops" in the "comment" column
receive_date --> leave blank
trailer_type --> data is located in the "TRAILER" column
load_size --> add text "Full"
weight --> data is located in the "WEIGHT" column, only the numbers the # sign is not needed
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> data located in the "RATE" column
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> see notes on destination_city and destination_state columns
load_number --> data is located in the "ORDER #" column
commodity --> data is located in the "COMMODITY" column
The first line of the output should contain all of the column headers.
Any field that contains no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'DFUSER576.pl' and the output file should be
called 'DFUSER576.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.