Need a web spider scraping program written for the following username DFUSER104922 -- 2
Budget: $30 – $250 USD
I need a web scraper written for the following url:
https://www.directfreight.com/emails/UV3H7Q7X7CHJHYVMFAV438/text-html2
All information needed is available on the main page. The number of rows will vary.
If a row is blank, skip that row. If a row repeats the column headers, skip that row.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "Pick up" column before the comma
origin_state --> data is located in the "Pick up" column after the comma
ship_date --> add the current day's date, change to the YYYY-MM-DD format
destination_city --> data is located in the "Deliver" column, if there are multiple city and states listed, the data to use will be the last listed after the last "/" and before the last comma
destination_state --> data is located in the "Deliver" column, if there are multiple city and states listed, the data to use will be the last listed after the last "/" and after the last comma
receive_date --> leave blank
trailer_type --> data is located in the "Genie/ Terex" column
load_size --> add text "Full"
weight --> data is located in the "Weight" column, the # symbol is not needed
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> data located in the "Monies" column, the "+ Permits" is not needed if located after data
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> data from the commodity and load_number columns will be here
load_number --> data located in the "Ref. #" column, add text "Ref. #" before the data
commodity --> data is located in the "Commodity" column
The first line of the output should contain all of the column headers.
Any field that contains no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'DFUSER104922.pl' and the output file should be
called 'DFUSER104922.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
https://www.directfreight.com/emails/UV3H7Q7X7CHJHYVMFAV438/text-html2
All information needed is available on the main page. The number of rows will vary.
If a row is blank, skip that row. If a row repeats the column headers, skip that row.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the "Pick up" column before the comma
origin_state --> data is located in the "Pick up" column after the comma
ship_date --> add the current day's date, change to the YYYY-MM-DD format
destination_city --> data is located in the "Deliver" column, if there are multiple city and states listed, the data to use will be the last listed after the last "/" and before the last comma
destination_state --> data is located in the "Deliver" column, if there are multiple city and states listed, the data to use will be the last listed after the last "/" and after the last comma
receive_date --> leave blank
trailer_type --> data is located in the "Genie/ Terex" column
load_size --> add text "Full"
weight --> data is located in the "Weight" column, the # symbol is not needed
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> data located in the "Monies" column, the "+ Permits" is not needed if located after data
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> data from the commodity and load_number columns will be here
load_number --> data located in the "Ref. #" column, add text "Ref. #" before the data
commodity --> data is located in the "Commodity" column
The first line of the output should contain all of the column headers.
Any field that contains no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
origin_city|origin_state|ship_date|destination_city|destination_state|
chicago|IL|2017-03-15|new york|NY|
kansas city|MO|2017-03-15|houston|TX|
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called 'DFUSER104922.pl' and the output file should be
called 'DFUSER104922.pipeSV'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.