Write a script to extract data from a Chinese website
Budget: £20 – £250 GBP
The task is to write a Python script to scrape the following website: http://zw.offcn.com, which contains information about vacancies at both the national and the local level. We would like to collect information for the date of the vacancy, the location of the vacancy, whether it is local or national, the department of the vacancy and the details of the position, etc.. Please see the attached Excel document which describes the general structure we want for the final data (note that this is just an example - the amount of information available will vary from case to case). Below we give examples for the local and national positions.
Let's start with the national-level positions. For example, the index of the position for the year 2012 is http://zw.offcn.com/gj/2012. The webpage lists the number of positions in each province. Following the link to each province, the webpage will list all positions in each department of the public sector from that province. This site https://zw.offcn.com/gj/jx/2012/ lists all positions in the Jiangxi province. We want to collect the full list of information about positions, including the column called details of the position (职位详情). For example, https://zw.offcn.com/gj/2012/bm3539_9.html is the list of positions in the tax department (税务局).
For the local level, the structure of the webpage is more or less the same. For each province, there is an index page. Again, take Jiangxi as an example. The link is https://jx.offcn.com/zw/2013/, where jx is short for the province Jiangxi. Then the structure is the same as for the national-level positions described above.
Let's start with the national-level positions. For example, the index of the position for the year 2012 is http://zw.offcn.com/gj/2012. The webpage lists the number of positions in each province. Following the link to each province, the webpage will list all positions in each department of the public sector from that province. This site https://zw.offcn.com/gj/jx/2012/ lists all positions in the Jiangxi province. We want to collect the full list of information about positions, including the column called details of the position (职位详情). For example, https://zw.offcn.com/gj/2012/bm3539_9.html is the list of positions in the tax department (税务局).
For the local level, the structure of the webpage is more or less the same. For each province, there is an index page. Again, take Jiangxi as an example. The link is https://jx.offcn.com/zw/2013/, where jx is short for the province Jiangxi. Then the structure is the same as for the national-level positions described above.