Companies House & FCA Register Web Scraping
Budget: £750 – £1,500 GBP
I am looking for a freelancer who is skilled in web scraping and data extraction to help me extract specific data points for 2,737 companies from Companies House and FCA Register websites.
Specific data points to be extracted for each company:
- Year established (column F): On Companies House, in the "Overview" section, you can find an item called "Incorporated on". Only need a year for this, not the full date
- Address (column G): Please take this from FCA Register, at the very top of the web page
- Number of FCA registered employees (column H): on FCA Register, there is a section called "Who is involved in activities with this firm?", and within that section you can see "Individuals", and within that "Current". I need to know the total number of people listed in that table (so the total number of current FCA certified employees)
- Company website (column I): You can take it from FCA register, section "Who is this firm?"
- Company e-mail (column J): You can take it from FCA register, section "Who is this firm?"
- Revenue for last 3 years, if available (columns K-M): Most of these companies disclose some sort of financial accounts (in pdf) on Companies House. Having said that, most of them do not disclose any income statement financials, only balance sheet. However, if available, please extract Revenue for the last 3 years (or fewer years if 3 years not available). Please note that Companies House have this database which you can use for the purposes of extracting all financial data: https://download.companieshouse.gov.uk/en_accountsdata.html (so probably no need to parse PDFs)
- Operating profit / EBIT for last 3 years, if available (columns N-P): Similar to Revenue above
- Total value of liabilities for last 3 years (current plus non-current), columns Q-S: Similar to Revenue above (but this item should be available for almost all companies in the list). Please note how I calculated it for the sample of 10 companies and make sure the calculation is the same for all the other companies
- Personnel costs, if available (column T): I doubt many companies would disclose this, but please check if there is any way to find total personnel / staff / wages costs in the latest yearly financial accounts from Companies House
- Number of Principal companies (column Y): On FCA register, in section "Who is his firm connected to?" >> "Principal Firms" >> "Current", I need to count how many firms are listed there. I expect that most of the companies will have only one listed principal firm there (St. James's Place Wealth Management Plc), but if there are more than one listed principal firms there, please make a note somewhere of all the principal firms. If the number of Principal firms if just one, then you put "Yes" in column Y. Otherwise you put "No"
- Names of directors (columns Z and AA): On Companies House, in section "People" >> "Officers", please extract all names of currently active directors (please do not include those that have any status other than "active")
- Year of birth for directors (column AC): For all directors from the item above, please extract year of birth (available on Companies House in the same section)
- Names of main beneficiaries (columns Z and AA): Similarly to directors, but within "People" section of Companies House, please go to "Persons with significant control". Please note that very often directors and main beneficiaries will coincide. In this case you should include a person only once and in the attached xls column AA you put the role as "Director & Beneficiary". If a person is only listed in "Officers", then in column AA you put "Director". If a person is listed only in "Persons with significant control", then you put in column AA "Beneficiary"
- Year of birth for main beneficiaries (column AC): Similarly to directors above
Companies List: Please refer to the attached pdf for the list of companies. We only need data for those companies that have the value in the column "AR Relationship" equal to "Full", so 2,747 companies (minus 10 companies that I have already done myself in the sample - see below). Please transfer this pdf file into and Excel file as well (the full file)
Please refer to the attached Excel file, where I have already filled in all the columns for a sample of 10 companies. Please take a look at this sample to understand exactly where each data item is coming from. I would ask you to send me back this Excel file with all 2,743 companies filled in. You only need to fill in columns D, F-T, V-AA, AC. For columns V-X you can take the information directly from the attached pdf file
Timeframe: I would like to see the first draft of the filled in Excel file within 1 week from the commencement date. Then subject to my quality check and comments, I will need the final project to be completed shortly after this.
I'm looking for a professional who has:
- Experience in web scraping and data extraction (ideally from the above two websites)
- Attention to detail (please note that I will perform detailed quality checks on my side because there is no margin for error here)
- Ability to communicate in English as there will likely be some back and forth on this assignment
Please reach out if you feel you are the right fit for this role.
Specific data points to be extracted for each company:
- Year established (column F): On Companies House, in the "Overview" section, you can find an item called "Incorporated on". Only need a year for this, not the full date
- Address (column G): Please take this from FCA Register, at the very top of the web page
- Number of FCA registered employees (column H): on FCA Register, there is a section called "Who is involved in activities with this firm?", and within that section you can see "Individuals", and within that "Current". I need to know the total number of people listed in that table (so the total number of current FCA certified employees)
- Company website (column I): You can take it from FCA register, section "Who is this firm?"
- Company e-mail (column J): You can take it from FCA register, section "Who is this firm?"
- Revenue for last 3 years, if available (columns K-M): Most of these companies disclose some sort of financial accounts (in pdf) on Companies House. Having said that, most of them do not disclose any income statement financials, only balance sheet. However, if available, please extract Revenue for the last 3 years (or fewer years if 3 years not available). Please note that Companies House have this database which you can use for the purposes of extracting all financial data: https://download.companieshouse.gov.uk/en_accountsdata.html (so probably no need to parse PDFs)
- Operating profit / EBIT for last 3 years, if available (columns N-P): Similar to Revenue above
- Total value of liabilities for last 3 years (current plus non-current), columns Q-S: Similar to Revenue above (but this item should be available for almost all companies in the list). Please note how I calculated it for the sample of 10 companies and make sure the calculation is the same for all the other companies
- Personnel costs, if available (column T): I doubt many companies would disclose this, but please check if there is any way to find total personnel / staff / wages costs in the latest yearly financial accounts from Companies House
- Number of Principal companies (column Y): On FCA register, in section "Who is his firm connected to?" >> "Principal Firms" >> "Current", I need to count how many firms are listed there. I expect that most of the companies will have only one listed principal firm there (St. James's Place Wealth Management Plc), but if there are more than one listed principal firms there, please make a note somewhere of all the principal firms. If the number of Principal firms if just one, then you put "Yes" in column Y. Otherwise you put "No"
- Names of directors (columns Z and AA): On Companies House, in section "People" >> "Officers", please extract all names of currently active directors (please do not include those that have any status other than "active")
- Year of birth for directors (column AC): For all directors from the item above, please extract year of birth (available on Companies House in the same section)
- Names of main beneficiaries (columns Z and AA): Similarly to directors, but within "People" section of Companies House, please go to "Persons with significant control". Please note that very often directors and main beneficiaries will coincide. In this case you should include a person only once and in the attached xls column AA you put the role as "Director & Beneficiary". If a person is only listed in "Officers", then in column AA you put "Director". If a person is listed only in "Persons with significant control", then you put in column AA "Beneficiary"
- Year of birth for main beneficiaries (column AC): Similarly to directors above
Companies List: Please refer to the attached pdf for the list of companies. We only need data for those companies that have the value in the column "AR Relationship" equal to "Full", so 2,747 companies (minus 10 companies that I have already done myself in the sample - see below). Please transfer this pdf file into and Excel file as well (the full file)
Please refer to the attached Excel file, where I have already filled in all the columns for a sample of 10 companies. Please take a look at this sample to understand exactly where each data item is coming from. I would ask you to send me back this Excel file with all 2,743 companies filled in. You only need to fill in columns D, F-T, V-AA, AC. For columns V-X you can take the information directly from the attached pdf file
Timeframe: I would like to see the first draft of the filled in Excel file within 1 week from the commencement date. Then subject to my quality check and comments, I will need the final project to be completed shortly after this.
I'm looking for a professional who has:
- Experience in web scraping and data extraction (ideally from the above two websites)
- Attention to detail (please note that I will perform detailed quality checks on my side because there is no margin for error here)
- Ability to communicate in English as there will likely be some back and forth on this assignment
Please reach out if you feel you are the right fit for this role.