Help Fixing Existing Python, MySQL, and Tableau Setup (Modifying Our Existing Setup)
Budget: $10 – $30 USD
We have been using the Boulevard "BLVD" as our booking & payment platform to track all our customer & booking data. We collect data from BLVD using Daily Recurring Report Exports through their API created by GraphQL, the report exports are in CSV format and the data is automatically updated.
All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data.
Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature)
I'm making this listing because I can't seem to fix the problems I'm running into, the person who managed the original setup quit and isn't willing to help me. I was sent the files to get it all running again, but I can't seem to get them working. He didn't send credentials to just use the AWS that was working fine, instead he sent a 2.11GB MySQL data dump export, 2 Python Scripts, and 3 Tableau Workbook Files.
I haven't been able to get the setup to work like it used to and keep getting errors. For example, the data on MySQL database & Tableau hasn't updated in months but the Report Export CSVs shows data from as recent as today, but our both MySQL and Tableau isn't showing this recent data. I believe this is due to the Python scripts not working right, even though everything had worked before.
I tried to migrate from MySQL to PostgreSQL hoping it might help solve my issues, I used a migration app to convert the dump from MySQL to PostgreSQL and ChatGPT to edit the Python scripts. In the end I was only able to view the migrated data on PostgreSQL but still it's only the old data from the data dump, no recent data.
*To clarify, you aren't starting from scratch, I just need slight modification to the existing setup*
-------------------------------------------------
What I need help with:
- Fixing the Python scripts to pull data & properly add it to the database without errors.
(I'm open to either fixing them or using an a better solution to replace them)
- Editing the SQL database to properly work with the data and Tableau
(This part might not be needed, since it originally worked but figured I would include it)
- Connecting the new data source to the 3 Tableau workbooks.
(Without loosing the existing configs/setup/calculations, or copy over the setup)
-------------------------------------------------
Additional Notes:
- I've tested using Amazon AWS and Google Cloud. (I have no preference)
- I'm open to using either MySQL or PostgreSQL. (Whichever works best)
- I have the original MySQL data-dump & migrated PostgreSQL data-dump.
- I have the original 2 Python scripts & the edited versions.
- The Tableau Workbooks are already setup with custom fields/calc/data/etc.
- The Flow is: BLVD > fileURL/CSV > Python > SQL Database > Tableau
Report Exports that we track are:
Client Records, Detailed Line Item, Gift Card Liabilities, Gift Card Redemptions, Location Records, Payments & Refunds, Product Records, Service Records, Subscriptions, Voucher Liabilities, and Voucher Redemptions.
-------------------------------------------------
Resources:
https://developers.joinblvd.com/2020-01/admin-api/guides/report-export
(Explains how fileURLs are used and the GraphQL setup)
https://support.boulevard.io/en/articles/9627397-subscriptions-report
(This covers all the fields for one of the report export CSVs, this is for Subscriptions)
https://support.boulevard.io/en/articles/9438032-report-index
(Explains reporting by name and includes key points, includes many reports we use)
https://ctxt.io/2/AAB4uVgrFw
(This is a text copy of some of the errors)
All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data.
Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature)
I'm making this listing because I can't seem to fix the problems I'm running into, the person who managed the original setup quit and isn't willing to help me. I was sent the files to get it all running again, but I can't seem to get them working. He didn't send credentials to just use the AWS that was working fine, instead he sent a 2.11GB MySQL data dump export, 2 Python Scripts, and 3 Tableau Workbook Files.
I haven't been able to get the setup to work like it used to and keep getting errors. For example, the data on MySQL database & Tableau hasn't updated in months but the Report Export CSVs shows data from as recent as today, but our both MySQL and Tableau isn't showing this recent data. I believe this is due to the Python scripts not working right, even though everything had worked before.
I tried to migrate from MySQL to PostgreSQL hoping it might help solve my issues, I used a migration app to convert the dump from MySQL to PostgreSQL and ChatGPT to edit the Python scripts. In the end I was only able to view the migrated data on PostgreSQL but still it's only the old data from the data dump, no recent data.
*To clarify, you aren't starting from scratch, I just need slight modification to the existing setup*
-------------------------------------------------
What I need help with:
- Fixing the Python scripts to pull data & properly add it to the database without errors.
(I'm open to either fixing them or using an a better solution to replace them)
- Editing the SQL database to properly work with the data and Tableau
(This part might not be needed, since it originally worked but figured I would include it)
- Connecting the new data source to the 3 Tableau workbooks.
(Without loosing the existing configs/setup/calculations, or copy over the setup)
-------------------------------------------------
Additional Notes:
- I've tested using Amazon AWS and Google Cloud. (I have no preference)
- I'm open to using either MySQL or PostgreSQL. (Whichever works best)
- I have the original MySQL data-dump & migrated PostgreSQL data-dump.
- I have the original 2 Python scripts & the edited versions.
- The Tableau Workbooks are already setup with custom fields/calc/data/etc.
- The Flow is: BLVD > fileURL/CSV > Python > SQL Database > Tableau
Report Exports that we track are:
Client Records, Detailed Line Item, Gift Card Liabilities, Gift Card Redemptions, Location Records, Payments & Refunds, Product Records, Service Records, Subscriptions, Voucher Liabilities, and Voucher Redemptions.
-------------------------------------------------
Resources:
https://developers.joinblvd.com/2020-01/admin-api/guides/report-export
(Explains how fileURLs are used and the GraphQL setup)
https://support.boulevard.io/en/articles/9627397-subscriptions-report
(This covers all the fields for one of the report export CSVs, this is for Subscriptions)
https://support.boulevard.io/en/articles/9438032-report-index
(Explains reporting by name and includes key points, includes many reports we use)
https://ctxt.io/2/AAB4uVgrFw
(This is a text copy of some of the errors)