Welcome to the MVP of the Connector Metadata Service!

This is BOTH a UI for visual exploration, AND a Restful API with these endpoints:

Docs

Source of this service is at https://github.com/airbytehq/mvp-cms

Expand to see README

Airbyte Connector Metadata Service

There are 3 sources of truth as far as connector metadata right now:

  1. actual connector source code in the github repo
  2. the manually maintained definitions files
  3. for cloud connectors, the cloud catalog

Our job is to unify them and serve them quickly from a simple RESTful API that is easy to edit, for consumption from docs, UI, and whatever else.

  • For most people, this is a read-only endeavor which means we can make use of simple infrastructure.
  • For connector maintainers, we need a simple and fast way to update connector metadata for consumption despite not having one source of truth

This means we need a data pipeline from:

  1. 3 sources of truth (external)
  2. manually maintained extra info (maintained here)
  3. combine 1 and 2 into a results.json and serve it from this app/site

We have NOT implemented this pipeline yet - we are hoping to agree on the desired output with this MVP and get an owner for this before working backwards on the pipeline.

Endpoints

Endpoints want to offer:

  • GET /connectors
    • /connectors - the smallest payload of connectors, minus internal connectors
      • listing ['name', 'dateAdded', 'displayName', 'description', 'websiteUrl', 'documentationUrl', 'iconUrl', 'releaseStage', 'connectorType']
    • /connectors?internal - small payload of all connectors including internal connectors
    • /connectors?full - just dumping the full results.json, which includes extra stuff like docker name, version, sourceDefinitionId, etc
  • GET /connector/{connector_name}
    • return full info for a single connector
    • 404 if unrecognized name

Future

in future we maybe want to offer:

  • search
  • update (for now we choose to just update by updating the results.json file, with possibly a google spreadsheet in the loop)

All known connectors

Display logos (may cause heavy image load)
name dateAdded releaseStage connectorType
source-activecampaign 2022-10-28 alpha source-api
source-adjust 2022-09-27 alpha source-api
source-airtable 2021-11-20 alpha source-api
source-alloydb 2022-09-07 generally_available source-db
source-amazon-ads 2021-08-26 generally_available source-api
source-amazon-seller-partner 2021-06-01 alpha source-api
destination-amazon-sqs 2021-12-10 alpha destination-db
source-amazon-sqs 2021-10-27 alpha destination-db
source-amplitude 2021-06-08 generally_available source-api
source-apify-dataset 2021-08-03 alpha source-api
source-appfollow 2022-08-17 alpha source-api
source-appstore-singer 2021-01-14 alpha source-api
source-asana 2021-05-26 beta source-api
source-ashby 2022-10-28 alpha source-api
source-auth0 2022-10-26 alpha source-api
source-aws-cloudtrail 2021-06-25 alpha source-api
destination-aws-datalake 2022-04-05 alpha destination-db
destination-azure-blob-storage 2021-08-29 alpha destination-db
source-azure-table 2021-11-15 alpha source-db
source-bamboo-hr 2021-08-27 alpha source-api
source-bigcommerce 2021-08-29 alpha source-api
destination-bigquery 2020-10-21 generally_available destination-db
source-bigquery 2021-07-22 alpha source-db
destination-bigquery-denormalized 2021-06-23 beta destination-db
source-bing-ads 2021-08-14 generally_available source-api
source-braintree 2021-08-19 alpha source-api
source-cart 2021-07-23 alpha source-api
destination-cassandra 2021-11-06 alpha destination-db
source-chargebee 2021-07-01 generally_available source-api
source-chargify 2022-03-17 alpha source-api
destination-keen 2021-08-18 alpha destination-db
source-chartmogul 2022-01-19 alpha source-api
destination-clickhouse 2021-12-14 alpha destination-db
source-clickhouse 2021-05-12 alpha source-db
source-clockify 2022-10-26 alpha source-api
source-close-com 2021-09-14 alpha source-api
destination-r2 2022-09-26 alpha destination-db
source-cockroachdb 2021-07-02 alpha source-db
source-coin-api 2022-10-28 alpha source-api
source-commercetools 2021-11-09 alpha source-api
source-confluence 2021-11-05 alpha source-api
source-convertkit 2022-10-29 alpha source-api
source-courier 2022-10-19 alpha source-api
destination-databricks 2021-09-15 alpha destination-db
source-delighted 2021-11-02 alpha source-api
source-dixa 2021-07-10 alpha source-api
source-dockerhub 2022-06-20 alpha source-api
source-drift 2020-12-18 alpha source-api
source-dv-360 2022-09-28 alpha source-api
destination-dynamodb 2021-09-02 alpha destination-db
destination-e2e-test 2021-05-25 undefined internal
source-e2e-test 2021-05-25 alpha internal
source-elasticsearch 2022-07-13 alpha source-db
destination-elasticsearch 2021-11-02 alpha destination-db
source-exchange-rates 2021-04-22 alpha source-api
source-facebook-marketing 2021-01-15 generally_available source-api
source-facebook-pages 2021-09-02 alpha source-api
source-faker 2022-04-14 alpha source-api
source-fauna 2022-09-29 alpha source-api
source-file 2020-11-03 generally_available source-file
destination-firebolt 2022-06-28 alpha destination-db
source-firebolt 2022-06-18 alpha source-db
source-flexport 2022-01-21 alpha source-api
source-freshcaller 2022-08-11 undefined source-api
source-freshdesk 2020-12-01 generally_available source-api
source-freshsales 2021-11-03 alpha source-api
source-freshservice 2021-10-29 alpha source-api
source-github 2021-07-07 generally_available source-api
source-gitlab 2021-07-06 alpha source-api
source-glassfrog 2022-07-27 alpha source-api
source-gocardless 2022-10-20 alpha source-api
source-google-ads 2021-06-14 generally_available source-api
source-google-analytics-v4 2021-08-26 generally_available source-api
source-google-analytics-data-api 2022-06-28 alpha source-api
destination-gcs 2021-07-17 beta destination-db
source-google-directory 2021-03-12 alpha source-db
destination-firestore 2021-11-22 alpha destination-db
destination-pubsub 2021-06-25 alpha destination-db
source-google-search-console 2021-09-10 generally_available source-api
destination-google-sheets 2022-05-12 alpha destination-db
source-google-sheets 2020-10-29 generally_available source-db
source-google-webfonts 2022-10-29 alpha source-api
source-google-workspace-admin-reports 2021-04-01 alpha source-api
source-greenhouse 2020-12-05 generally_available source-api
source-gutendex 2022-10-21 alpha source-api
source-harvest 2021-06-07 generally_available source-api
source-hellobaton 2022-01-14 alpha source-api
source-hubplanner 2022-08-10 alpha source-api
source-hubspot 2021-03-20 generally_available source-api
source-db2 2021-06-24 alpha source-db
source-insightly 2022-10-20 alpha source-api
source-instagram 2021-03-13 generally_available source-api
source-intercom 2021-07-19 generally_available source-api
source-iterable 2021-04-20 generally_available source-api
source-jira 2020-12-10 alpha source-api
destination-kafka 2021-07-22 alpha destination-db
source-kafka 2021-09-23 alpha source-db
destination-kinesis 2021-11-22 alpha destination-db
source-klaviyo 2021-05-20 generally_available source-api
source-kustomer-singer 2021-08-05 alpha source-api
source-kyriba 2022-07-13 alpha source-api
source-lemlist 2021-10-27 alpha source-api
source-lever-hiring 2021-09-10 alpha source-api
source-linkedin-ads 2021-09-25 generally_available source-api
source-linkedin-pages 2022-08-11 alpha source-api
source-linnworks 2021-11-16 alpha source-api
destination-csv 2020-10-21 alpha destination-file
destination-local-json 2020-12-22 alpha destination-file
destination-sqlite 2022-08-09 alpha destination-db
source-lokalise 2022-10-28 alpha source-api
source-looker 2020-12-25 alpha source-api
source-mailchimp 2020-11-13 generally_available source-api
source-mailerlite 2022-10-28 alpha source-api
source-mailgun 2021-12-08 alpha source-api
source-mailjet-mail 2022-10-28 alpha source-api
source-mailjet-sms 2022-10-29 alpha source-api
destination-mariadb-columnstore 2021-11-24 alpha destination-db
source-marketo 2021-09-24 generally_available source-api
destination-meilisearch 2021-02-09 alpha destination-db
source-metabase 2022-06-23 alpha source-api
source-mssql 2020-11-14 alpha source-db
source-microsoft-teams 2020-12-22 alpha source-api
source-mixpanel 2021-07-20 generally_available source-api
source-monday 2021-11-07 alpha source-api
destination-mongodb 2021-09-07 alpha destination-db
source-mongodb-v2 2021-09-09 alpha source-db
destination-mqtt 2021-11-21 alpha destination-db
destination-mssql 2021-05-17 alpha destination-db
source-my-hours 2021-12-21 alpha source-api
destination-mysql 2021-05-07 alpha destination-db
source-mysql 2020-10-30 beta source-db
source-nasa 2022-10-28 alpha source-api
source-netsuite 2022-09-22 alpha source-api
source-news-api 2022-10-27 alpha source-api
source-notion 2021-11-19 generally_available source-api
source-okta 2021-06-02 alpha source-api
source-omnisend 2022-10-31 alpha source-api
source-onesignal 2021-10-22 alpha source-api
source-openweather 2021-12-16 alpha source-api
destination-oracle 2021-06-03 alpha destination-db
source-oracle 2021-04-01 alpha source-db
source-orb 2022-02-21 alpha source-api
source-orbit 2022-06-27 alpha source-api
source-oura 2022-10-28 alpha source-api
source-outreach 2021-11-23 alpha source-api
source-paypal-transaction 2021-07-09 generally_available source-api
source-paystack 2021-11-02 alpha source-api
source-persistiq 2022-01-22 alpha source-api
source-pinterest 2021-11-09 generally_available source-api
source-pipedrive 2021-07-19 alpha source-api
source-pivotal-tracker 2022-04-05 alpha source-api
source-plaid 2020-12-31 alpha source-api
source-pokeapi 2021-05-05 alpha tutorial
destination-postgres 2020-10-21 alpha destination-db
source-postgres 2020-11-03 generally_available source-db
source-posthog 2021-06-09 alpha source-api
source-prestashop 2021-07-27 alpha source-api
source-primetric 2022-09-22 alpha source-api
destination-pulsar 2021-11-06 alpha destination-db
source-qualaroo 2021-12-22 alpha source-api
source-quickbooks-singer 2021-04-17 alpha source-api
destination-rabbitmq 2021-12-14 alpha destination-db
source-rd-station-marketing 2022-10-28 alpha source-api
source-recharge 2021-05-20 generally_available source-api
source-recurly 2020-11-25 alpha source-api
destination-redis 2021-11-20 alpha destination-db
destination-redshift 2020-12-04 beta destination-db
source-redshift 2020-12-01 alpha source-db
source-retently 2021-11-02 alpha source-api
source-rki-covid 2022-05-30 alpha source-api
destination-rockset 2021-12-15 alpha destination-db
destination-s3 2021-06-03 generally_available destination-file
source-s3 2021-07-30 generally_available source-file
source-salesforce 2021-09-08 generally_available source-api
source-salesloft 2021-10-22 alpha source-api
destination-scylla 2021-11-17 alpha destination-db
source-search-metrics 2021-12-23 alpha source-api
source-sendgrid 2020-11-24 beta source-api
source-sentry 2021-11-03 generally_available source-api
source-sftp 2022-05-30 alpha source-file
source-sftp-bulk 2022-10-28 alpha source-file
destination-sftp-json 2021-11-24 alpha destination-db
source-shopify 2021-06-08 alpha source-api
source-shortio 2021-08-16 alpha source-api
source-slack 2021-04-20 generally_available source-api
source-smartsheets 2021-04-15 beta source-api
source-snapchat-marketing 2021-07-29 generally_available source-api
destination-snowflake 2020-11-02 generally_available destination-db
source-snowflake 2021-06-11 alpha source-db
source-sonar-cloud 2022-10-28 alpha source-api
source-square 2021-07-08 alpha source-api
source-strava 2021-10-26 alpha source-api
source-stripe 2021-04-07 generally_available source-api
source-surveymonkey 2021-07-06 generally_available source-api
source-talkdesk-explore 2022-05-27 alpha source-api
source-tempo 2021-01-12 alpha source-api
destination-tidb 2022-09-01 alpha destination-db
source-tidb 2022-04-21 alpha source-db
source-tiktok-marketing 2021-10-16 generally_available source-api
source-timely 2022-07-15 alpha source-api
source-trello 2021-08-25 alpha source-api
source-tvmaze-schedule 2022-10-28 alpha source-api
source-twilio 2021-07-04 generally_available source-api
source-typeform 2021-07-13 alpha source-api
destination-typesense 2022-10-28 alpha destination-db
destination-clickhouse-strict-encrypt 2021-12-14 undefined internal
destination-dev-null 2021-12-19 undefined internal
destination-elasticsearch-strict-encrypt 2022-09-22 undefined internal
destination-jdbc 2020-12-04 undefined internal
destination-kvdb 2021-07-19 undefined internal
destination-mongodb-strict-encrypt 2021-10-20 undefined internal
destination-mssql-strict-encrypt 2021-10-12 undefined internal
destination-mysql-strict-encrypt 2021-10-14 undefined internal
destination-oracle-strict-encrypt 2021-11-02 undefined internal
destination-postgres-strict-encrypt 2021-09-30 undefined internal
destination-scaffold-destination-python 2021-07-19 undefined internal
source-alloydb-strict-encrypt 2022-09-20 undefined internal
source-appsflyer 2021-10-19 undefined source-api
source-clickhouse-strict-encrypt 2021-10-25 undefined internal
source-cockroachdb-strict-encrypt 2021-11-24 undefined internal
source-db2-strict-encrypt 2021-11-11 undefined internal
source-e2e-test-cloud 2022-01-24 undefined internal
source-file-secure 2021-10-20 undefined internal
source-jdbc 2020-10-30 undefined internal
source-mongodb 2021-03-09 undefined source-db
source-mongodb-strict-encrypt 2021-10-11 undefined internal
source-mssql-strict-encrypt 2021-10-08 undefined internal
source-mysql-strict-encrypt 2021-10-05 undefined internal
source-oracle-strict-encrypt 2021-10-14 undefined internal
source-pardot 2021-11-19 undefined source-api
source-postgres-strict-encrypt 2021-09-27 undefined internal
source-python-http-tutorial 2021-04-27 undefined tutorial
source-relational-db 2021-07-06 undefined internal
source-scaffold-java-jdbc 2021-06-09 undefined internal
source-scaffold-source-http 2021-04-26 undefined internal
source-scaffold-source-python 2021-02-17 undefined internal
source-stock-ticker-api-tutorial 2021-01-07 undefined tutorial
source-tplcentral 2021-12-28 undefined source-api
source-yahoo-finance-price 2022-03-24 undefined source-api
source-us-census 2021-07-20 alpha source-api
source-waiteraid 2022-10-29 alpha source-api
source-webflow 2022-06-22 alpha source-api
source-whisky-hunter 2022-10-21 alpha source-api
source-woocommerce 2021-10-07 alpha source-api
source-workable 2022-10-27 alpha source-api
source-wrike 2022-09-16 alpha source-api
source-xkcd 2022-10-22 alpha tutorial
source-yandex-metrica 2022-09-20 alpha source-api
source-youtube-analytics 2021-11-19 beta source-api
destination-yugabytedb 2022-10-28 alpha destination-db
source-zendesk-chat 2021-05-04 generally_available source-api
source-zendesk-sell 2022-10-29 alpha source-api
source-zendesk-sunshine 2021-07-09 alpha source-api
source-zendesk-support 2021-08-03 generally_available source-api
source-zendesk-talk 2021-04-14 generally_available source-api
source-zenefits 2022-09-22 alpha source-api
source-zenloop 2021-11-23 alpha source-api
source-zoho-crm 2022-04-06 alpha source-api
source-zoom 2022-10-26 alpha source-api
source-zuora 2021-08-05 alpha source-api