Using the GPU in the cloud
Here is an example workflow for how to use the GPU in the cloud to render your videos using EC2 instances.
Launch an EC2 instance
You might need to ask AWS for a limit increase for the number of GPUs you can use.
You can do this in the AWS console.
Go to "Service Quotas" -> "AWS Services" -> "Amazon Elastic Compute Cloud (Amazon EC2)" -> "Running On-Demand G and VT instances" -> "Request increase at account-level".
You may also click here to go to the page directly for the us-east-1
region.
Click here launch an EC2 instance on us-east-1
.
Select "Browse more AMIs", search for ami-053b0d53c279acc90
, select the "Community AMIs" tab and select the image with the right AMI ("ubuntu/images/hvm-ssd/ubuntu-jammy-22.04-amd64-server-20230516").
We recommend the g4dn.xlarge
size - note that this instance costs $375 per month with the default configuration.
If you get a message "Subscribing to AMI is taking longer than expected", it is normal. You may need to wait a few minutes.
Once you connected to the instance, run the following commands:
Upgrade the Linux Kernel to v6bash
sudo bash -c "apt update && export DEBIAN_FRONTEND=noninteractive && export NEEDRESTART_MODE=a && apt upgrade -y && reboot"
Upgrade the Linux Kernel to v6bash
sudo bash -c "apt update && export DEBIAN_FRONTEND=noninteractive && export NEEDRESTART_MODE=a && apt upgrade -y && reboot"
The instance will restart and therefore disconnect. Wait a few moments and then reconnect.
Install libvulkanbash
sudo apt install -y build-essential libvulkan1
Install libvulkanbash
sudo apt install -y build-essential libvulkan1
Install GPU driversbash
DRIVER_URL="https://us.download.nvidia.com/tesla/535.104.12/NVIDIA-Linux-x86_64-535.104.12.run"DRIVER_NAME="NVIDIA-Linux-driver.run"wget -O "$DRIVER_NAME" "$DRIVER_URL"sudo sh "$DRIVER_NAME" --disable-nouveau --silentrm "$DRIVER_NAME"
Install GPU driversbash
DRIVER_URL="https://us.download.nvidia.com/tesla/535.104.12/NVIDIA-Linux-x86_64-535.104.12.run"DRIVER_NAME="NVIDIA-Linux-driver.run"wget -O "$DRIVER_NAME" "$DRIVER_URL"sudo sh "$DRIVER_NAME" --disable-nouveau --silentrm "$DRIVER_NAME"
Configure startup servicebash
echo '[Unit]Description=Run nvidia-smi at system startup[Service]ExecStart=/usr/bin/nvidia-smiType=oneshotRemainAfterExit=yes[Install]WantedBy=multi-user.target' | sudo tee /etc/systemd/system/nvidia-smi.servicesudo systemctl enable nvidia-smi.servicesudo systemctl start nvidia-smi.service
Configure startup servicebash
echo '[Unit]Description=Run nvidia-smi at system startup[Service]ExecStart=/usr/bin/nvidia-smiType=oneshotRemainAfterExit=yes[Install]WantedBy=multi-user.target' | sudo tee /etc/systemd/system/nvidia-smi.servicesudo systemctl enable nvidia-smi.servicesudo systemctl start nvidia-smi.service
Install Chromebash
curl -fsSL https://dl.google.com/linux/linux_signing_key.pub | sudo gpg --dearmor -o /usr/share/keyrings/googlechrom-keyring.gpgecho "deb [arch=amd64 signed-by=/usr/share/keyrings/googlechrom-keyring.gpg] http://dl.google.com/linux/chrome/deb/ stable main" | sudo tee /etc/apt/sources.list.d/google-chrome.listsudo apt updatesudo apt install -y google-chrome-stable curl gnupg ca-certificates
Install Chromebash
curl -fsSL https://dl.google.com/linux/linux_signing_key.pub | sudo gpg --dearmor -o /usr/share/keyrings/googlechrom-keyring.gpgecho "deb [arch=amd64 signed-by=/usr/share/keyrings/googlechrom-keyring.gpg] http://dl.google.com/linux/chrome/deb/ stable main" | sudo tee /etc/apt/sources.list.d/google-chrome.listsudo apt updatesudo apt install -y google-chrome-stable curl gnupg ca-certificates
Install Node.jsbash
sudo mkdir -p /etc/apt/keyringscurl -fsSL https://deb.nodesource.com/gpgkey/nodesource-repo.gpg.key | sudo gpg --dearmor -o /etc/apt/keyrings/nodesource.gpgNODE_MAJOR=20echo "deb [signed-by=/etc/apt/keyrings/nodesource.gpg] https://deb.nodesource.com/node_$NODE_MAJOR.x nodistro main" | sudo tee /etc/apt/sources.list.d/nodesource.listsudo apt-get updatesudo apt-get install nodejs -y
Install Node.jsbash
sudo mkdir -p /etc/apt/keyringscurl -fsSL https://deb.nodesource.com/gpgkey/nodesource-repo.gpg.key | sudo gpg --dearmor -o /etc/apt/keyrings/nodesource.gpgNODE_MAJOR=20echo "deb [signed-by=/etc/apt/keyrings/nodesource.gpg] https://deb.nodesource.com/node_$NODE_MAJOR.x nodistro main" | sudo tee /etc/apt/sources.list.d/nodesource.listsudo apt-get updatesudo apt-get install nodejs -y
Clone a Remotion GPU demobash
git clone https://github.com/remotion-dev/gpu-scenecd gpu-scenenpm inpx remotion render --browser-executable=/usr/bin/google-chrome-stable --gl=angle-egl --enable-multiprocess-on-linux
Clone a Remotion GPU demobash
git clone https://github.com/remotion-dev/gpu-scenecd gpu-scenenpm inpx remotion render --browser-executable=/usr/bin/google-chrome-stable --gl=angle-egl --enable-multiprocess-on-linux
See also
- Supercharging Headless Browsers with GPU Hardware Acceleration on AWS EC2, on which this document is based on.