Secure Data Matching Integration Service Development
Budget: $50 – $0 AUD
I'm seeking an experienced Azure Apps Services/APIM RestAPI Developer to build a new secure data matching integration service. The service is to be designed to allow organizations who sign up to the subscription service, to use an API service from their designated system, e.g. Finance, CRM, SAP, DB service, Salesforce or other, to query against a large data matching service established in Azure.
This service will establish Azure middleware as a set of Serverless functions.
Key Responsibilities:
- Develop a new repeatable service model API capable of data matching, user authentication, and encryption.
- Establish a service with data security and data matching accuracy with logic applied to match responses soring / weighted score.
- Develop service capability up to MVP level.
Ideal Skills:
- Extensive experience with Azure Apps Services / APIM, App Logic, Error handling and retry
- Proficiency in developing Serverless functions in Azure App Services architecture
- Strong understanding of building secure a-sync APIs - receive request, validate the correlation id, response with acknowledgment and perform search function against AzureSQL, pass back match result.
- Knowledge of data matching techniques - Azure AI Search, vector search, full text search, hybrid search, assigning a rank (matching) score.
- Ability to implement user identification, authentication and encryption (in transit and rest) using OAuth2.
- Database design and indexing knowledge for large data querying, search algorithms using AzureSQL
Target Environment
API Manager - API gateway to authenticate any incoming requests
Logic Apps - Workflows and business logic
Function - Services to perform complex logic
Key Vault - To store sensitive data
Service Bus - Queue to allow a-sync processing and retry mechanism
Azure AD - Admin and user access
API connector - Office365 SMTP mail alerts
Project Outline.
Design and Analysis - Detailed Design documentation -
API contract
API Detailed Design
Environment establishment - Azure PaaS –
Azure tenancy and subscription enablement
Azure AD
APIM
OAuth authentication
Azure Service Log Analytics
Logic App - Azure function, encryption etc
Integration Accounts
Key Vaults
Retry Queue
HTTPS request
Deploy Shared resources:
Resource Group
Service Bus
Log Analytics
Key Vault
APIM
Storage Account
Function App
API connector
Azure SQL
Development tools:
Logic app designer
Logic app code view
API development - Azure Apps Logic Rules Engine
Vector Search in Azure AI Search / Cognitive Search, or text search, hybrid search
Indexing and retry strategy
Deliverables: Configuration table, Payload definition, Field names and type, Responses
Azure table(s), Database connector
Implementation of retry and error handling - Azure table, Save retry and alerts configurations
Unit, functional and SIT testing for POC - Functional support role only, must have experience with API test tools such as Postman.
POC with subset of data for internal test of matching service.
Deployment to MVP level with one AU customer - using full scale production database, data load up to 20M records, assist with customer API onboarding - provide API documentation and setup auth for customer in App Services.
The service Functional Specification will be provided.
Documentation for how authenticated services (clients) connect to the service is also key and this will be a subscription service with a charging model of a per query / match service.
Project scope will be up to POC, then MVP for AU region. MVP is needed mid November 2024.
This project requires a developer who can deliver a high-quality, secure, and efficient service able to scale this service within the AU region initially, then internationally. Accordingly strong developer AND documentation skills are needed.
If you are skilled in these areas - and these key areas of knowledge are clearly evident in your resume, and have a track record of successful project completion, I would love to hear from you.
Project will have milestone payment arrangement based on delivery of the above for the right developer.
Project is ready to commence immediately with a 6-7 week timeframe to deliver up to MVP capability.
Will also provide ongoing work based on successful delivery of the above MVP.
This service will establish Azure middleware as a set of Serverless functions.
Key Responsibilities:
- Develop a new repeatable service model API capable of data matching, user authentication, and encryption.
- Establish a service with data security and data matching accuracy with logic applied to match responses soring / weighted score.
- Develop service capability up to MVP level.
Ideal Skills:
- Extensive experience with Azure Apps Services / APIM, App Logic, Error handling and retry
- Proficiency in developing Serverless functions in Azure App Services architecture
- Strong understanding of building secure a-sync APIs - receive request, validate the correlation id, response with acknowledgment and perform search function against AzureSQL, pass back match result.
- Knowledge of data matching techniques - Azure AI Search, vector search, full text search, hybrid search, assigning a rank (matching) score.
- Ability to implement user identification, authentication and encryption (in transit and rest) using OAuth2.
- Database design and indexing knowledge for large data querying, search algorithms using AzureSQL
Target Environment
API Manager - API gateway to authenticate any incoming requests
Logic Apps - Workflows and business logic
Function - Services to perform complex logic
Key Vault - To store sensitive data
Service Bus - Queue to allow a-sync processing and retry mechanism
Azure AD - Admin and user access
API connector - Office365 SMTP mail alerts
Project Outline.
Design and Analysis - Detailed Design documentation -
API contract
API Detailed Design
Environment establishment - Azure PaaS –
Azure tenancy and subscription enablement
Azure AD
APIM
OAuth authentication
Azure Service Log Analytics
Logic App - Azure function, encryption etc
Integration Accounts
Key Vaults
Retry Queue
HTTPS request
Deploy Shared resources:
Resource Group
Service Bus
Log Analytics
Key Vault
APIM
Storage Account
Function App
API connector
Azure SQL
Development tools:
Logic app designer
Logic app code view
API development - Azure Apps Logic Rules Engine
Vector Search in Azure AI Search / Cognitive Search, or text search, hybrid search
Indexing and retry strategy
Deliverables: Configuration table, Payload definition, Field names and type, Responses
Azure table(s), Database connector
Implementation of retry and error handling - Azure table, Save retry and alerts configurations
Unit, functional and SIT testing for POC - Functional support role only, must have experience with API test tools such as Postman.
POC with subset of data for internal test of matching service.
Deployment to MVP level with one AU customer - using full scale production database, data load up to 20M records, assist with customer API onboarding - provide API documentation and setup auth for customer in App Services.
The service Functional Specification will be provided.
Documentation for how authenticated services (clients) connect to the service is also key and this will be a subscription service with a charging model of a per query / match service.
Project scope will be up to POC, then MVP for AU region. MVP is needed mid November 2024.
This project requires a developer who can deliver a high-quality, secure, and efficient service able to scale this service within the AU region initially, then internationally. Accordingly strong developer AND documentation skills are needed.
If you are skilled in these areas - and these key areas of knowledge are clearly evident in your resume, and have a track record of successful project completion, I would love to hear from you.
Project will have milestone payment arrangement based on delivery of the above for the right developer.
Project is ready to commence immediately with a 6-7 week timeframe to deliver up to MVP capability.
Will also provide ongoing work based on successful delivery of the above MVP.