❄️ Pierre Munhoz engineering blog

How to host Airbyte on Google Cloud Platform?

1 min read

In this article I’ll show you how to setup Airbyte on Google Cloud Platform.

Setup of Airbyte on the VM

Create your Virtual Machine

According to Airbyte documentation here the requirements:

  • To test Airbyte, we recommend an e2.medium instance and provision at least 30GBs of disk per node
  • To deploy Airbyte in a production environment, we recommend a n1-standard-2 instance

Install Docker & docker-compose

Install docker on your VM

sudo apt-get update
sudo apt-get install -y apt-transport-https ca-certificates curl gnupg2 software-properties-common
curl -fsSL https://download.docker.com/linux/debian/gpg | sudo apt-key add --
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/debian buster stable"
sudo apt-get update
sudo apt-get install -y docker-ce docker-ce-cli containerd.io
sudo usermod -a -G docker $USER

Then install docker compose

sudo apt-get -y install docker-compose-plugin
docker compose version

Then close your SSH connection and open it again to take into account the modifications.

Install Airbyte

mkdir airbyte && cd airbyte
wget https://raw.githubusercontent.com/airbytehq/airbyte/master/run-ab-platform.sh
chmod +x run-ab-platform.sh
./run-ab-platform.sh -b

Connection to your Airbyte instance

Now that you’ve set up Airbyte on your machine and started the instance, you can mirror it but running this command and access it here http://localhost:8000.

gcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME -- -L 8000:localhost:8000 -N -f

Graph View