WEB CRAWLER

Job ID: 32758815

Budget: $3,000 – $5,000 USD

1. Create or build or make Web-crawler or user-agent

2. Create custom APIs server with multiple end points and multiple clients
3. Build a Custom database
4. Create API Tools (including API Creator, API Integrator or Connector, API Management)

Build a database –including enabling or integration and configuration of APIs
Search or extract the search engines content, data, information, etc. through or via the web including search engines queries.
Store the results or findings of the search in the database.
Query or extract or retrieve (including query conditions, sub-query, criteria, requirements, parameters) the database content or data for:
Affiliate programs
Information, news, current affairs or events.
Reseller programs
Store the results or findings of the search in the database for affiliate programs
information, news, current affairs or events, reseller programs in the database.
Query or extract or retrieve (including query conditions, sub-query, criteria, requirements, parameters) the affiliate programs in the database content or data for:
Affiliate products and /or services
Query or extract or retrieve (including query conditions, sub-query, criteria, requirements, parameters) the reseller programs in the database content or data for:
Reseller products and/or services.
Integrate, configure, connect tasks APIs.
Project APIs
Business Partners APIs include the affiliate programs. For examples Click Bank, Warrior Plus, JVzoo etc.
Business Partners APIs include the Reseller programs. For examples Microsoft, Hostgator, etc.
Public APIs include the social media, Twitter, WordPress etc.
Catalog or Display of APIs: Public domain APIs Intersection traffic broker.

COMPONENT-BASED DEVELOPMENT: INTEGRATE OPEN SOURCE SOFTWARE PACKAGES OR COMPONENTS.

I am looking for various software packages or components for components-based development. The software packages or components are:

Web-crawler or spider-robot or user-agent or search engine.

API Server with multiple end points and multiple clients.

Custom database

API Tools: API Creator, API Integrator or connector, and API management.

Integrated Social media.

Content creator or aggregator or curator including English composition

Email marketing/Auto-Responding

Payment gateway Stripe.

Environment: Optimum and maximum automation and Artificial Intelligence or machine learning or self