Welcome to the MVP of the Connector Metadata Service!
This is BOTH a UI for visual exploration, AND a Restful API with these endpoints:
- GET
/connectors
- /connectors - the smallest payload of connectors, minus internal connectors
- listing
['name', 'dateAdded', 'displayName', 'description', 'websiteUrl', 'documentationUrl', 'iconUrl', 'releaseStage', 'connectorType']
- listing
- /connectors?internal - small payload of all connectors including internal connectors
- /connectors?full - just dumping the full
results.json
, which includes extra stuff like docker name, version, sourceDefinitionId, etc
- /connectors - the smallest payload of connectors, minus internal connectors
- GET
/connector/{connector_name}
- return full info for a single connector
- 404 if unrecognized name
Docs
Source of this service is at https://github.com/airbytehq/mvp-cms
Expand to see README
Airbyte Connector Metadata Service
There are 3 sources of truth as far as connector metadata right now:
- actual connector source code in the github repo
- https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors
- extracted with
git2json.js
which generatesgit2json.json
which we paste over to this project
- the manually maintained definitions files
- for cloud connectors, the cloud catalog
Our job is to unify them and serve them quickly from a simple RESTful API that is easy to edit, for consumption from docs, UI, and whatever else.
- For most people, this is a read-only endeavor which means we can make use of simple infrastructure.
- For connector maintainers, we need a simple and fast way to update connector metadata for consumption despite not having one source of truth
This means we need a data pipeline from:
- 3 sources of truth (external)
- manually maintained extra info (maintained here)
- combine 1 and 2 into a
results.json
and serve it from this app/site
We have NOT implemented this pipeline yet - we are hoping to agree on the desired output with this MVP and get an owner for this before working backwards on the pipeline.
Endpoints
Endpoints want to offer:
- GET
/connectors
- /connectors - the smallest payload of connectors, minus internal connectors
- listing
['name', 'dateAdded', 'displayName', 'description', 'websiteUrl', 'documentationUrl', 'iconUrl', 'releaseStage', 'connectorType']
- listing
- /connectors?internal - small payload of all connectors including internal connectors
- /connectors?full - just dumping the full
results.json
, which includes extra stuff like docker name, version, sourceDefinitionId, etc
- /connectors - the smallest payload of connectors, minus internal connectors
- GET
/connector/{connector_name}
- return full info for a single connector
- 404 if unrecognized name
Future
in future we maybe want to offer:
- search
- update (for now we choose to just update by updating the results.json file, with possibly a google spreadsheet in the loop)
All known connectors
Display logos (may cause heavy image load)
name | dateAdded | releaseStage | connectorType | |
---|---|---|---|---|
source-activecampaign | 2022-10-28 | alpha | source-api | ▲ |
source-adjust | 2022-09-27 | alpha | source-api | ▲ |
source-airtable | 2021-11-20 | alpha | source-api | ▲ |
source-alloydb | 2022-09-07 | generally_available | source-db | ▲ |
source-amazon-ads | 2021-08-26 | generally_available | source-api | ▲ |
source-amazon-seller-partner | 2021-06-01 | alpha | source-api | ▲ |
destination-amazon-sqs | 2021-12-10 | alpha | destination-db | ▲ |
source-amazon-sqs | 2021-10-27 | alpha | destination-db | ▲ |
source-amplitude | 2021-06-08 | generally_available | source-api | ▲ |
source-apify-dataset | 2021-08-03 | alpha | source-api | ▲ |
source-appfollow | 2022-08-17 | alpha | source-api | ▲ |
source-appstore-singer | 2021-01-14 | alpha | source-api | ▲ |
source-asana | 2021-05-26 | beta | source-api | ▲ |
source-ashby | 2022-10-28 | alpha | source-api | ▲ |
source-auth0 | 2022-10-26 | alpha | source-api | ▲ |
source-aws-cloudtrail | 2021-06-25 | alpha | source-api | ▲ |
destination-aws-datalake | 2022-04-05 | alpha | destination-db | ▲ |
destination-azure-blob-storage | 2021-08-29 | alpha | destination-db | ▲ |
source-azure-table | 2021-11-15 | alpha | source-db | ▲ |
source-bamboo-hr | 2021-08-27 | alpha | source-api | ▲ |
source-bigcommerce | 2021-08-29 | alpha | source-api | ▲ |
destination-bigquery | 2020-10-21 | generally_available | destination-db | ▲ |
source-bigquery | 2021-07-22 | alpha | source-db | ▲ |
destination-bigquery-denormalized | 2021-06-23 | beta | destination-db | ▲ |
source-bing-ads | 2021-08-14 | generally_available | source-api | ▲ |
source-braintree | 2021-08-19 | alpha | source-api | ▲ |
source-cart | 2021-07-23 | alpha | source-api | ▲ |
destination-cassandra | 2021-11-06 | alpha | destination-db | ▲ |
source-chargebee | 2021-07-01 | generally_available | source-api | ▲ |
source-chargify | 2022-03-17 | alpha | source-api | ▲ |
destination-keen | 2021-08-18 | alpha | destination-db | ▲ |
source-chartmogul | 2022-01-19 | alpha | source-api | ▲ |
destination-clickhouse | 2021-12-14 | alpha | destination-db | ▲ |
source-clickhouse | 2021-05-12 | alpha | source-db | ▲ |
source-clockify | 2022-10-26 | alpha | source-api | ▲ |
source-close-com | 2021-09-14 | alpha | source-api | ▲ |
destination-r2 | 2022-09-26 | alpha | destination-db | ▲ |
source-cockroachdb | 2021-07-02 | alpha | source-db | ▲ |
source-coin-api | 2022-10-28 | alpha | source-api | ▲ |
source-commercetools | 2021-11-09 | alpha | source-api | ▲ |
source-confluence | 2021-11-05 | alpha | source-api | ▲ |
source-convertkit | 2022-10-29 | alpha | source-api | ▲ |
source-courier | 2022-10-19 | alpha | source-api | ▲ |
destination-databricks | 2021-09-15 | alpha | destination-db | ▲ |
source-delighted | 2021-11-02 | alpha | source-api | ▲ |
source-dixa | 2021-07-10 | alpha | source-api | ▲ |
source-dockerhub | 2022-06-20 | alpha | source-api | ▲ |
source-drift | 2020-12-18 | alpha | source-api | ▲ |
source-dv-360 | 2022-09-28 | alpha | source-api | ▲ |
destination-dynamodb | 2021-09-02 | alpha | destination-db | ▲ |
destination-e2e-test | 2021-05-25 | undefined | internal | ▲ |
source-e2e-test | 2021-05-25 | alpha | internal | ▲ |
source-elasticsearch | 2022-07-13 | alpha | source-db | ▲ |
destination-elasticsearch | 2021-11-02 | alpha | destination-db | ▲ |
source-exchange-rates | 2021-04-22 | alpha | source-api | ▲ |
source-facebook-marketing | 2021-01-15 | generally_available | source-api | ▲ |
source-facebook-pages | 2021-09-02 | alpha | source-api | ▲ |
source-faker | 2022-04-14 | alpha | source-api | ▲ |
source-fauna | 2022-09-29 | alpha | source-api | ▲ |
source-file | 2020-11-03 | generally_available | source-file | ▲ |
destination-firebolt | 2022-06-28 | alpha | destination-db | ▲ |
source-firebolt | 2022-06-18 | alpha | source-db | ▲ |
source-flexport | 2022-01-21 | alpha | source-api | ▲ |
source-freshcaller | 2022-08-11 | undefined | source-api | ▲ |
source-freshdesk | 2020-12-01 | generally_available | source-api | ▲ |
source-freshsales | 2021-11-03 | alpha | source-api | ▲ |
source-freshservice | 2021-10-29 | alpha | source-api | ▲ |
source-github | 2021-07-07 | generally_available | source-api | ▲ |
source-gitlab | 2021-07-06 | alpha | source-api | ▲ |
source-glassfrog | 2022-07-27 | alpha | source-api | ▲ |
source-gocardless | 2022-10-20 | alpha | source-api | ▲ |
source-google-ads | 2021-06-14 | generally_available | source-api | ▲ |
source-google-analytics-v4 | 2021-08-26 | generally_available | source-api | ▲ |
source-google-analytics-data-api | 2022-06-28 | alpha | source-api | ▲ |
destination-gcs | 2021-07-17 | beta | destination-db | ▲ |
source-google-directory | 2021-03-12 | alpha | source-db | ▲ |
destination-firestore | 2021-11-22 | alpha | destination-db | ▲ |
destination-pubsub | 2021-06-25 | alpha | destination-db | ▲ |
source-google-search-console | 2021-09-10 | generally_available | source-api | ▲ |
destination-google-sheets | 2022-05-12 | alpha | destination-db | ▲ |
source-google-sheets | 2020-10-29 | generally_available | source-db | ▲ |
source-google-webfonts | 2022-10-29 | alpha | source-api | ▲ |
source-google-workspace-admin-reports | 2021-04-01 | alpha | source-api | ▲ |
source-greenhouse | 2020-12-05 | generally_available | source-api | ▲ |
source-gutendex | 2022-10-21 | alpha | source-api | ▲ |
source-harvest | 2021-06-07 | generally_available | source-api | ▲ |
source-hellobaton | 2022-01-14 | alpha | source-api | ▲ |
source-hubplanner | 2022-08-10 | alpha | source-api | ▲ |
source-hubspot | 2021-03-20 | generally_available | source-api | ▲ |
source-db2 | 2021-06-24 | alpha | source-db | ▲ |
source-insightly | 2022-10-20 | alpha | source-api | ▲ |
source-instagram | 2021-03-13 | generally_available | source-api | ▲ |
source-intercom | 2021-07-19 | generally_available | source-api | ▲ |
source-iterable | 2021-04-20 | generally_available | source-api | ▲ |
source-jira | 2020-12-10 | alpha | source-api | ▲ |
destination-kafka | 2021-07-22 | alpha | destination-db | ▲ |
source-kafka | 2021-09-23 | alpha | source-db | ▲ |
destination-kinesis | 2021-11-22 | alpha | destination-db | ▲ |
source-klaviyo | 2021-05-20 | generally_available | source-api | ▲ |
source-kustomer-singer | 2021-08-05 | alpha | source-api | ▲ |
source-kyriba | 2022-07-13 | alpha | source-api | ▲ |
source-lemlist | 2021-10-27 | alpha | source-api | ▲ |
source-lever-hiring | 2021-09-10 | alpha | source-api | ▲ |
source-linkedin-ads | 2021-09-25 | generally_available | source-api | ▲ |
source-linkedin-pages | 2022-08-11 | alpha | source-api | ▲ |
source-linnworks | 2021-11-16 | alpha | source-api | ▲ |
destination-csv | 2020-10-21 | alpha | destination-file | ▲ |
destination-local-json | 2020-12-22 | alpha | destination-file | ▲ |
destination-sqlite | 2022-08-09 | alpha | destination-db | ▲ |
source-lokalise | 2022-10-28 | alpha | source-api | ▲ |
source-looker | 2020-12-25 | alpha | source-api | ▲ |
source-mailchimp | 2020-11-13 | generally_available | source-api | ▲ |
source-mailerlite | 2022-10-28 | alpha | source-api | ▲ |
source-mailgun | 2021-12-08 | alpha | source-api | ▲ |
source-mailjet-mail | 2022-10-28 | alpha | source-api | ▲ |
source-mailjet-sms | 2022-10-29 | alpha | source-api | ▲ |
destination-mariadb-columnstore | 2021-11-24 | alpha | destination-db | ▲ |
source-marketo | 2021-09-24 | generally_available | source-api | ▲ |
destination-meilisearch | 2021-02-09 | alpha | destination-db | ▲ |
source-metabase | 2022-06-23 | alpha | source-api | ▲ |
source-mssql | 2020-11-14 | alpha | source-db | ▲ |
source-microsoft-teams | 2020-12-22 | alpha | source-api | ▲ |
source-mixpanel | 2021-07-20 | generally_available | source-api | ▲ |
source-monday | 2021-11-07 | alpha | source-api | ▲ |
destination-mongodb | 2021-09-07 | alpha | destination-db | ▲ |
source-mongodb-v2 | 2021-09-09 | alpha | source-db | ▲ |
destination-mqtt | 2021-11-21 | alpha | destination-db | ▲ |
destination-mssql | 2021-05-17 | alpha | destination-db | ▲ |
source-my-hours | 2021-12-21 | alpha | source-api | ▲ |
destination-mysql | 2021-05-07 | alpha | destination-db | ▲ |
source-mysql | 2020-10-30 | beta | source-db | ▲ |
source-nasa | 2022-10-28 | alpha | source-api | ▲ |
source-netsuite | 2022-09-22 | alpha | source-api | ▲ |
source-news-api | 2022-10-27 | alpha | source-api | ▲ |
source-notion | 2021-11-19 | generally_available | source-api | ▲ |
source-okta | 2021-06-02 | alpha | source-api | ▲ |
source-omnisend | 2022-10-31 | alpha | source-api | ▲ |
source-onesignal | 2021-10-22 | alpha | source-api | ▲ |
source-openweather | 2021-12-16 | alpha | source-api | ▲ |
destination-oracle | 2021-06-03 | alpha | destination-db | ▲ |
source-oracle | 2021-04-01 | alpha | source-db | ▲ |
source-orb | 2022-02-21 | alpha | source-api | ▲ |
source-orbit | 2022-06-27 | alpha | source-api | ▲ |
source-oura | 2022-10-28 | alpha | source-api | ▲ |
source-outreach | 2021-11-23 | alpha | source-api | ▲ |
source-paypal-transaction | 2021-07-09 | generally_available | source-api | ▲ |
source-paystack | 2021-11-02 | alpha | source-api | ▲ |
source-persistiq | 2022-01-22 | alpha | source-api | ▲ |
source-pinterest | 2021-11-09 | generally_available | source-api | ▲ |
source-pipedrive | 2021-07-19 | alpha | source-api | ▲ |
source-pivotal-tracker | 2022-04-05 | alpha | source-api | ▲ |
source-plaid | 2020-12-31 | alpha | source-api | ▲ |
source-pokeapi | 2021-05-05 | alpha | tutorial | ▲ |
destination-postgres | 2020-10-21 | alpha | destination-db | ▲ |
source-postgres | 2020-11-03 | generally_available | source-db | ▲ |
source-posthog | 2021-06-09 | alpha | source-api | ▲ |
source-prestashop | 2021-07-27 | alpha | source-api | ▲ |
source-primetric | 2022-09-22 | alpha | source-api | ▲ |
destination-pulsar | 2021-11-06 | alpha | destination-db | ▲ |
source-qualaroo | 2021-12-22 | alpha | source-api | ▲ |
source-quickbooks-singer | 2021-04-17 | alpha | source-api | ▲ |
destination-rabbitmq | 2021-12-14 | alpha | destination-db | ▲ |
source-rd-station-marketing | 2022-10-28 | alpha | source-api | ▲ |
source-recharge | 2021-05-20 | generally_available | source-api | ▲ |
source-recurly | 2020-11-25 | alpha | source-api | ▲ |
destination-redis | 2021-11-20 | alpha | destination-db | ▲ |
destination-redshift | 2020-12-04 | beta | destination-db | ▲ |
source-redshift | 2020-12-01 | alpha | source-db | ▲ |
source-retently | 2021-11-02 | alpha | source-api | ▲ |
source-rki-covid | 2022-05-30 | alpha | source-api | ▲ |
destination-rockset | 2021-12-15 | alpha | destination-db | ▲ |
destination-s3 | 2021-06-03 | generally_available | destination-file | ▲ |
source-s3 | 2021-07-30 | generally_available | source-file | ▲ |
source-salesforce | 2021-09-08 | generally_available | source-api | ▲ |
source-salesloft | 2021-10-22 | alpha | source-api | ▲ |
destination-scylla | 2021-11-17 | alpha | destination-db | ▲ |
source-search-metrics | 2021-12-23 | alpha | source-api | ▲ |
source-sendgrid | 2020-11-24 | beta | source-api | ▲ |
source-sentry | 2021-11-03 | generally_available | source-api | ▲ |
source-sftp | 2022-05-30 | alpha | source-file | ▲ |
source-sftp-bulk | 2022-10-28 | alpha | source-file | ▲ |
destination-sftp-json | 2021-11-24 | alpha | destination-db | ▲ |
source-shopify | 2021-06-08 | alpha | source-api | ▲ |
source-shortio | 2021-08-16 | alpha | source-api | ▲ |
source-slack | 2021-04-20 | generally_available | source-api | ▲ |
source-smartsheets | 2021-04-15 | beta | source-api | ▲ |
source-snapchat-marketing | 2021-07-29 | generally_available | source-api | ▲ |
destination-snowflake | 2020-11-02 | generally_available | destination-db | ▲ |
source-snowflake | 2021-06-11 | alpha | source-db | ▲ |
source-sonar-cloud | 2022-10-28 | alpha | source-api | ▲ |
source-square | 2021-07-08 | alpha | source-api | ▲ |
source-strava | 2021-10-26 | alpha | source-api | ▲ |
source-stripe | 2021-04-07 | generally_available | source-api | ▲ |
source-surveymonkey | 2021-07-06 | generally_available | source-api | ▲ |
source-talkdesk-explore | 2022-05-27 | alpha | source-api | ▲ |
source-tempo | 2021-01-12 | alpha | source-api | ▲ |
destination-tidb | 2022-09-01 | alpha | destination-db | ▲ |
source-tidb | 2022-04-21 | alpha | source-db | ▲ |
source-tiktok-marketing | 2021-10-16 | generally_available | source-api | ▲ |
source-timely | 2022-07-15 | alpha | source-api | ▲ |
source-trello | 2021-08-25 | alpha | source-api | ▲ |
source-tvmaze-schedule | 2022-10-28 | alpha | source-api | ▲ |
source-twilio | 2021-07-04 | generally_available | source-api | ▲ |
source-typeform | 2021-07-13 | alpha | source-api | ▲ |
destination-typesense | 2022-10-28 | alpha | destination-db | ▲ |
destination-clickhouse-strict-encrypt | 2021-12-14 | undefined | internal | ▲ |
destination-dev-null | 2021-12-19 | undefined | internal | ▲ |
destination-elasticsearch-strict-encrypt | 2022-09-22 | undefined | internal | ▲ |
destination-jdbc | 2020-12-04 | undefined | internal | ▲ |
destination-kvdb | 2021-07-19 | undefined | internal | ▲ |
destination-mongodb-strict-encrypt | 2021-10-20 | undefined | internal | ▲ |
destination-mssql-strict-encrypt | 2021-10-12 | undefined | internal | ▲ |
destination-mysql-strict-encrypt | 2021-10-14 | undefined | internal | ▲ |
destination-oracle-strict-encrypt | 2021-11-02 | undefined | internal | ▲ |
destination-postgres-strict-encrypt | 2021-09-30 | undefined | internal | ▲ |
destination-scaffold-destination-python | 2021-07-19 | undefined | internal | ▲ |
source-alloydb-strict-encrypt | 2022-09-20 | undefined | internal | ▲ |
source-appsflyer | 2021-10-19 | undefined | source-api | ▲ |
source-clickhouse-strict-encrypt | 2021-10-25 | undefined | internal | ▲ |
source-cockroachdb-strict-encrypt | 2021-11-24 | undefined | internal | ▲ |
source-db2-strict-encrypt | 2021-11-11 | undefined | internal | ▲ |
source-e2e-test-cloud | 2022-01-24 | undefined | internal | ▲ |
source-file-secure | 2021-10-20 | undefined | internal | ▲ |
source-jdbc | 2020-10-30 | undefined | internal | ▲ |
source-mongodb | 2021-03-09 | undefined | source-db | ▲ |
source-mongodb-strict-encrypt | 2021-10-11 | undefined | internal | ▲ |
source-mssql-strict-encrypt | 2021-10-08 | undefined | internal | ▲ |
source-mysql-strict-encrypt | 2021-10-05 | undefined | internal | ▲ |
source-oracle-strict-encrypt | 2021-10-14 | undefined | internal | ▲ |
source-pardot | 2021-11-19 | undefined | source-api | ▲ |
source-postgres-strict-encrypt | 2021-09-27 | undefined | internal | ▲ |
source-python-http-tutorial | 2021-04-27 | undefined | tutorial | ▲ |
source-relational-db | 2021-07-06 | undefined | internal | ▲ |
source-scaffold-java-jdbc | 2021-06-09 | undefined | internal | ▲ |
source-scaffold-source-http | 2021-04-26 | undefined | internal | ▲ |
source-scaffold-source-python | 2021-02-17 | undefined | internal | ▲ |
source-stock-ticker-api-tutorial | 2021-01-07 | undefined | tutorial | ▲ |
source-tplcentral | 2021-12-28 | undefined | source-api | ▲ |
source-yahoo-finance-price | 2022-03-24 | undefined | source-api | ▲ |
source-us-census | 2021-07-20 | alpha | source-api | ▲ |
source-waiteraid | 2022-10-29 | alpha | source-api | ▲ |
source-webflow | 2022-06-22 | alpha | source-api | ▲ |
source-whisky-hunter | 2022-10-21 | alpha | source-api | ▲ |
source-woocommerce | 2021-10-07 | alpha | source-api | ▲ |
source-workable | 2022-10-27 | alpha | source-api | ▲ |
source-wrike | 2022-09-16 | alpha | source-api | ▲ |
source-xkcd | 2022-10-22 | alpha | tutorial | ▲ |
source-yandex-metrica | 2022-09-20 | alpha | source-api | ▲ |
source-youtube-analytics | 2021-11-19 | beta | source-api | ▲ |
destination-yugabytedb | 2022-10-28 | alpha | destination-db | ▲ |
source-zendesk-chat | 2021-05-04 | generally_available | source-api | ▲ |
source-zendesk-sell | 2022-10-29 | alpha | source-api | ▲ |
source-zendesk-sunshine | 2021-07-09 | alpha | source-api | ▲ |
source-zendesk-support | 2021-08-03 | generally_available | source-api | ▲ |
source-zendesk-talk | 2021-04-14 | generally_available | source-api | ▲ |
source-zenefits | 2022-09-22 | alpha | source-api | ▲ |
source-zenloop | 2021-11-23 | alpha | source-api | ▲ |
source-zoho-crm | 2022-04-06 | alpha | source-api | ▲ |
source-zoom | 2022-10-26 | alpha | source-api | ▲ |
source-zuora | 2021-08-05 | alpha | source-api | ▲ |