Docker Desktop networking can work when attached to a VPN. To do this, Docker Desktop intercepts traffic from the containers and injects it into Windows as if it originated from the Docker application. When you run a container with the -p argument, for example. The official Windows base image for containers. It is now possible to run Docker containers on Windows 10 and Windows Server, leveraging Ubuntu as a hosting base. Imagine running your own Linux applications on Windows, using a Linux distribution you are comfortable with: Ubuntu! It is now possible to do so using the power of Docker technology and Hyper-V virtualization on Windows.
- Windows Docker Run
- Windows Docker Run Dockerfile
- Windows Docker Runtime
- Windows Docker Running Linux
- Windows Docker Run -v
- Windows Docker Run Command
With a couple of tweaks the WSL (Windows Subsystem for Linux, also known as Bash for Windows) can be used with Docker for Windows.
Quick Jump: Configure Docker for Windows (Docker Desktop)|Install Docker and Docker Compose within WSL|Configure WSL to Connect to Docker for Windows|Ensure Volume Mounts Work
This post only applies to WSL 1!
Check out the WSL 2 PostUpdate in 2020: Now that Microsoft has released the Spring 2020 Windows update we have access to WSL 2 on all editions of Windows 10 (including Home). They even backported in support for WSL 2 in Windows versions 1903 and 1909.
I've recorded a video of how I have Docker Desktop along with WSL 2 working together along with other tools that I use.
I've decided to keep this post unmodified and fully working for WSL 1 in case you want to continue using it. Just know that I've moved on to using WSL 2 and that none of the steps below are necessary to do with WSL 2.
This article expects you to have WSL set up already. If you don't, I have another article that goes over how to set up an amazing WSL based development environment within Windows. You can even run graphical apps and it doesn't require a VM.
Onwards we go…
While the Docker daemon cannot run directly on WSL, you can use the Docker CLI to connect to a remote Docker daemon running through Docker for Windows or any other VM you create (this article covers both methods).
If you're wondering 'why not just run docker.exe and docker-compose.exe from Docker for Windows directly in WSL?', that's due to a bug with running Docker or Docker Compose interactively in that environment. The TL;DR is you can't run anything in the foreground with interactive mode, which makes it unusable for real web development.
But with the Docker CLI configured to the remote Docker for Windows host it's really awesome! Using this method, very large Rails applications respond in ~100ms (or ~5s when having to compile 10,000+ lines of Javascript and SCSS). That's with mounted volumes too!
I use this set up pretty much every day for Rails, Flask, Phoenix, Node and Webpack driven apps. It's very solid in terms of performance and reliability.
Configure Docker for Windows (Docker Desktop)
In the general settings, you'll want to expose the daemon without TLS.
Windows Docker Run
Docker for Windows has been recently renamed to Docker Desktop, so if your settings look slightly different than the screenshot, no worries. It's the same thing.
It mentions 'use with caution' because any time you make a network connection that's not encrypted, it's worth talking about but in this case it's completely safe because we're never connecting to it over a public network.
This is going to allow your local WSL instance to connect locally to the Docker daemon running within Docker for Windows. The traffic isn't even leaving your dev box since the daemon is only bound to localhost, so not even other machines on your local network will be able to connect. In other words, it's very safe for this data to be transmit over plain text.
You may also want to share any drives you plan on having your source code reside on. This step isn't necessary but I keep my code on an internal secondary HD, so I shared my 'E' drive too. If you do that, goto the 'Shared Drives' setting and enable it.
Can't use Docker for Windows?
This is only necessary if you are NOT running Docker for Windows!
You'll want to set up your own VM to run Docker. Docker Tip #73 goes into detail on how to do this, and it even includes links to videos on how to configure the VM.
Install Docker and Docker Compose within WSL
Everyone can follow along at this point!
We still need to install Docker and Docker Compose inside of WSL because it'll give us access to both CLI apps. We just won't bother starting the Docker daemon.
The following instructions are for Ubuntu 18.04 / 20.04, but if you happen to use a different WSL distribution, you can follow Docker's installation guide for your distro from Docker's installation docs.
Install Docker
You can copy / paste all of the commands below into your WSL terminal.
Ubuntu 18.04 / 20.04 installation notes taken from Docker's documentation:
At this point you must close your terminal and open a new one so that you can run Docker without sudo. You might as well do it now!
Install Docker Compose
We're going to install Docker Compose using PIP instead of the pre-compiled binary on GitHub because it runs a little bit faster (both are still Python apps).
The next step is to make sure $HOME/.local/bin is set on your WSL $PATH.
You can check if it's already set by running echo $PATH. Depending on what WSL distro you use, you may or may not see /home/nick/.local/bin (replace nick with your username).
If it's there, you're good to go and can skip to the next section of this post.
If it's not there, you'll want to add it to your $PATH. You can do that by opening up your profile file with nano ~/.profile. Then anywhere in the file, on a new line, add export PATH='$PATH:$HOME/.local/bin' and save the file.
Finally, run source ~/.profile to active your new $PATH and confirm it works by running echo $PATH. You should see it there now. Done!
Configure WSL to Connect to Docker for Windows
The next step is to configure WSL so that it knows how to connect to the remote Docker daemon running in Docker for Windows (remember, it's listening on port 2375).
If you're not using Docker for Windows and followed Docker Tip #73's guide to create your own VM then you probably did this already which means you can skip the command below.
Connect to a remote Docker daemon with this 1 liner:
echo 'export DOCKER_HOST=tcp://localhost:2375' >> ~/.bashrc && source ~/.bashrc
That just adds the export line to your .bashrc file so it's available every time you open your terminal. The source commands reloads your bash configuration so you don't have to open a new terminal right now for it to take effect.
Verify Everything Works
Ensure Volume Mounts Work
The last thing we need to do is set things up so that volume mounts work. This tripped me up for a while because check this out…
When using WSL, Docker for Windows expects you to supply your volume paths in a format that matches this: /c/Users/nick/dev/myapp.
But, WSL doesn't work like that. Instead, it uses the /mnt/c/Users/nick/dev/myapp format. Honestly I think Docker should change their path to use /mnt/c because it's more clear on what's going on, but that's a discussion for another time.
To get things to work for now, you have 2 options. If you're running Windows 18.03 (Spring 2018) or newer you can configure WSL to mount at / instead of /mnt and you're all done. If you're running 17.09 (Fall 2017) you'll need to do something else.
Here's step by step instructions for both versions of Windows:
Running Windows 10 18.03+ or Newer?
First up, open a WSL terminal because we need to run a few commands.
Create and modify the new WSL configuration file:
We need to set root = / because this will make your drives mounted at /c or /e instead of /mnt/c or /mnt/e.
Windows Docker Run Dockerfile
The options = 'metadata' line is not necessary but it will fix folder and file permissions on WSL mounts so everything isn't 777 all the time within the WSL mounts. I highly recommend you do this!
Once you make those changes, sign out and sign back in to Windows to ensure the changes take effect. Win + L isn't enough. You'll need to do a full blown sign out / sign in.
If you get an error the next time you start your WSL terminal don't freak out.
It's a bug with 18.03 and you can easily fix it. Hit CTRL + Shift + ECS to open the task manager, goto the 'Services' tab, find the 'LxssManager' service and restart it.
This seems to only happen if you sign out of Windows instead of doing a full reboot and will likely be fixed in a future 18.03+ patch.
Once that's done, you're all set. You'll be able to access your mounts and they will work perfectly with Docker and Docker Compose without any additional adjustments. For example you'll be able to use .:/myapp in a docker-compose.yml file, etc.
What terminal emulator are you using?
If you're using ConEmu, then you'll want to make sure to upgrade to the latest alpha release (at least 18.05.06+ which you can see in the title bar of the settings). It contains a patched wslbridge.exe file to support a custom WSL root mount point.
The default Ubuntu WSL terminal supports this by default, so you're all good. I don't know if other terminals support this yet. Let me know in the comments.
You're all done! You can skip the 17.09 steps below if you followed the above steps.
Running Windows 10 17.09?
First up, open a WSL terminal because we need to run a few commands.
Bind custom mount points to fix Docker for Windows and WSL differences:
You'll want to repeat those commands for any drives that you shared, such as d or e, etc.
Verify that it works by running: ls -la /c. You should see the same exact output as running ls -la /mnt/c because /mnt/c is mounted to /c.
At this point you're golden. You can use volume mount paths like .:/myapp in your Docker Compose files and everything will work like normal. That's awesome because that format is what native Linux and MacOS users also use.
It's worth noting that whenever you run a docker-compose up, you'll want to make sure you navigate to the /c/Users/nick/dev/myapp location first, otherwise your volume won't work. In other words, never access /mnt/c directly.
Technically you could use a symlink instead of a bind mount, but I've been burned in the past when it came to using symlinks and having certain tools not work because they failed to follow them correctly. Better safe than sorry here.
However, feel free to use symlinks inside WSL to access your bind mount. For example my Dev folder lives all the way in /e/Backup/VMs/workstation/home/nick/Dev and there's no way in heck I'm going to always type that when I want to access my development files.
So inside WSL I created a symlink with ln -s /e/Backup/VMs/workstation/home/nick/Dev ~/Dev and now I can just type cd ~/Dev to access my files and everything works.
Automatically set up the bind mount:
Unfortunately you will have to run that sudo mount command every time you open a new terminal because WSL doesn't support mounting through /etc/fstab yet (edit: it does in 18.09+, but if you're using 18.09+ you should follow the 18.03+ steps).
But we can work around that limitation by just mounting it in your ~/.bashrc file. This is a little dirty but as far as I know, I think this is the only way to do it, so if you know of a better way, please let me know.
You can do that with this 1 liner: echo 'sudo mount --bind /mnt/c /c' >> ~/.bashrc && source ~/.bashrc and make sure to repeat the command for any additional drives you shared with Docker for Windows. By the way, you don't need to mkdir because we already did it.
Yes I know, that means you will be prompt for your root password every time you open a terminal, but we can get around that too because Linux is cool like that.
Allow your user to bind a mount without a root password:
Windows Docker Runtime
To do that, run the sudo visudo command.
That should open up nano (a text editor). Goto the bottom of the file and add this line: nick ALL=(root) NOPASSWD: /bin/mount, but replace 'nick' with your username.
Bootable sierra usb. That just allows your user to execute the sudo mount command without having to supply a password. You can save the file with CTRL + O, confirm and exit with CTRL + X.
For the purposes of this article, we'll cover Zoom, Skype, and Hangouts, in particular. How to Use Snap Camera Filters on Zoom To use Snap Camera, your computer needs to be running at least Windows 7 or macOS 10.12 and have a working webcam. Hangouts app osx. You can play YouTube videos and others within the app, so you don't need to embed code or anything. With inline bots, such as @gif, @pic/bing, @vid/YouTube, etc, you can look things up without leaving the client or chat that you're in. Simply type the name and some keywords and wait for the results to load.
Mission complete. You're all set to win at life by using Docker for Windows and WSL.
Let me know how it goes in the comments!
Estimated reading time: 4 minutes
Docker Desktop provides several networking features to make it easier touse.
Features
VPN Passthrough
Docker Desktop networking can work when attached to a VPN. To do this,Docker Desktop intercepts traffic from the containers and injects it intoWindows as if it originated from the Docker application.
Onwards we go…
While the Docker daemon cannot run directly on WSL, you can use the Docker CLI to connect to a remote Docker daemon running through Docker for Windows or any other VM you create (this article covers both methods).
If you're wondering 'why not just run docker.exe and docker-compose.exe from Docker for Windows directly in WSL?', that's due to a bug with running Docker or Docker Compose interactively in that environment. The TL;DR is you can't run anything in the foreground with interactive mode, which makes it unusable for real web development.
But with the Docker CLI configured to the remote Docker for Windows host it's really awesome! Using this method, very large Rails applications respond in ~100ms (or ~5s when having to compile 10,000+ lines of Javascript and SCSS). That's with mounted volumes too!
I use this set up pretty much every day for Rails, Flask, Phoenix, Node and Webpack driven apps. It's very solid in terms of performance and reliability.
Configure Docker for Windows (Docker Desktop)
In the general settings, you'll want to expose the daemon without TLS.
Windows Docker Run
Docker for Windows has been recently renamed to Docker Desktop, so if your settings look slightly different than the screenshot, no worries. It's the same thing.
It mentions 'use with caution' because any time you make a network connection that's not encrypted, it's worth talking about but in this case it's completely safe because we're never connecting to it over a public network.
This is going to allow your local WSL instance to connect locally to the Docker daemon running within Docker for Windows. The traffic isn't even leaving your dev box since the daemon is only bound to localhost, so not even other machines on your local network will be able to connect. In other words, it's very safe for this data to be transmit over plain text.
You may also want to share any drives you plan on having your source code reside on. This step isn't necessary but I keep my code on an internal secondary HD, so I shared my 'E' drive too. If you do that, goto the 'Shared Drives' setting and enable it.
Can't use Docker for Windows?
This is only necessary if you are NOT running Docker for Windows!
You'll want to set up your own VM to run Docker. Docker Tip #73 goes into detail on how to do this, and it even includes links to videos on how to configure the VM.
Install Docker and Docker Compose within WSL
Everyone can follow along at this point!
We still need to install Docker and Docker Compose inside of WSL because it'll give us access to both CLI apps. We just won't bother starting the Docker daemon.
The following instructions are for Ubuntu 18.04 / 20.04, but if you happen to use a different WSL distribution, you can follow Docker's installation guide for your distro from Docker's installation docs.
Install Docker
You can copy / paste all of the commands below into your WSL terminal.
Ubuntu 18.04 / 20.04 installation notes taken from Docker's documentation:
At this point you must close your terminal and open a new one so that you can run Docker without sudo. You might as well do it now!
Install Docker Compose
We're going to install Docker Compose using PIP instead of the pre-compiled binary on GitHub because it runs a little bit faster (both are still Python apps).
The next step is to make sure $HOME/.local/bin is set on your WSL $PATH.
You can check if it's already set by running echo $PATH. Depending on what WSL distro you use, you may or may not see /home/nick/.local/bin (replace nick with your username).
If it's there, you're good to go and can skip to the next section of this post.
If it's not there, you'll want to add it to your $PATH. You can do that by opening up your profile file with nano ~/.profile. Then anywhere in the file, on a new line, add export PATH='$PATH:$HOME/.local/bin' and save the file.
Finally, run source ~/.profile to active your new $PATH and confirm it works by running echo $PATH. You should see it there now. Done!
Configure WSL to Connect to Docker for Windows
The next step is to configure WSL so that it knows how to connect to the remote Docker daemon running in Docker for Windows (remember, it's listening on port 2375).
If you're not using Docker for Windows and followed Docker Tip #73's guide to create your own VM then you probably did this already which means you can skip the command below.
Connect to a remote Docker daemon with this 1 liner:
echo 'export DOCKER_HOST=tcp://localhost:2375' >> ~/.bashrc && source ~/.bashrc
That just adds the export line to your .bashrc file so it's available every time you open your terminal. The source commands reloads your bash configuration so you don't have to open a new terminal right now for it to take effect.
Verify Everything Works
Ensure Volume Mounts Work
The last thing we need to do is set things up so that volume mounts work. This tripped me up for a while because check this out…
When using WSL, Docker for Windows expects you to supply your volume paths in a format that matches this: /c/Users/nick/dev/myapp.
But, WSL doesn't work like that. Instead, it uses the /mnt/c/Users/nick/dev/myapp format. Honestly I think Docker should change their path to use /mnt/c because it's more clear on what's going on, but that's a discussion for another time.
To get things to work for now, you have 2 options. If you're running Windows 18.03 (Spring 2018) or newer you can configure WSL to mount at / instead of /mnt and you're all done. If you're running 17.09 (Fall 2017) you'll need to do something else.
Here's step by step instructions for both versions of Windows:
Running Windows 10 18.03+ or Newer?
First up, open a WSL terminal because we need to run a few commands.
Create and modify the new WSL configuration file:
We need to set root = / because this will make your drives mounted at /c or /e instead of /mnt/c or /mnt/e.
Windows Docker Run Dockerfile
The options = 'metadata' line is not necessary but it will fix folder and file permissions on WSL mounts so everything isn't 777 all the time within the WSL mounts. I highly recommend you do this!
Once you make those changes, sign out and sign back in to Windows to ensure the changes take effect. Win + L isn't enough. You'll need to do a full blown sign out / sign in.
If you get an error the next time you start your WSL terminal don't freak out.
It's a bug with 18.03 and you can easily fix it. Hit CTRL + Shift + ECS to open the task manager, goto the 'Services' tab, find the 'LxssManager' service and restart it.
This seems to only happen if you sign out of Windows instead of doing a full reboot and will likely be fixed in a future 18.03+ patch.
Once that's done, you're all set. You'll be able to access your mounts and they will work perfectly with Docker and Docker Compose without any additional adjustments. For example you'll be able to use .:/myapp in a docker-compose.yml file, etc.
What terminal emulator are you using?
If you're using ConEmu, then you'll want to make sure to upgrade to the latest alpha release (at least 18.05.06+ which you can see in the title bar of the settings). It contains a patched wslbridge.exe file to support a custom WSL root mount point.
The default Ubuntu WSL terminal supports this by default, so you're all good. I don't know if other terminals support this yet. Let me know in the comments.
You're all done! You can skip the 17.09 steps below if you followed the above steps.
Running Windows 10 17.09?
First up, open a WSL terminal because we need to run a few commands.
Bind custom mount points to fix Docker for Windows and WSL differences:
You'll want to repeat those commands for any drives that you shared, such as d or e, etc.
Verify that it works by running: ls -la /c. You should see the same exact output as running ls -la /mnt/c because /mnt/c is mounted to /c.
At this point you're golden. You can use volume mount paths like .:/myapp in your Docker Compose files and everything will work like normal. That's awesome because that format is what native Linux and MacOS users also use.
It's worth noting that whenever you run a docker-compose up, you'll want to make sure you navigate to the /c/Users/nick/dev/myapp location first, otherwise your volume won't work. In other words, never access /mnt/c directly.
Technically you could use a symlink instead of a bind mount, but I've been burned in the past when it came to using symlinks and having certain tools not work because they failed to follow them correctly. Better safe than sorry here.
However, feel free to use symlinks inside WSL to access your bind mount. For example my Dev folder lives all the way in /e/Backup/VMs/workstation/home/nick/Dev and there's no way in heck I'm going to always type that when I want to access my development files.
So inside WSL I created a symlink with ln -s /e/Backup/VMs/workstation/home/nick/Dev ~/Dev and now I can just type cd ~/Dev to access my files and everything works.
Automatically set up the bind mount:
Unfortunately you will have to run that sudo mount command every time you open a new terminal because WSL doesn't support mounting through /etc/fstab yet (edit: it does in 18.09+, but if you're using 18.09+ you should follow the 18.03+ steps).
But we can work around that limitation by just mounting it in your ~/.bashrc file. This is a little dirty but as far as I know, I think this is the only way to do it, so if you know of a better way, please let me know.
You can do that with this 1 liner: echo 'sudo mount --bind /mnt/c /c' >> ~/.bashrc && source ~/.bashrc and make sure to repeat the command for any additional drives you shared with Docker for Windows. By the way, you don't need to mkdir because we already did it.
Yes I know, that means you will be prompt for your root password every time you open a terminal, but we can get around that too because Linux is cool like that.
Allow your user to bind a mount without a root password:
Windows Docker Runtime
To do that, run the sudo visudo command.
That should open up nano (a text editor). Goto the bottom of the file and add this line: nick ALL=(root) NOPASSWD: /bin/mount, but replace 'nick' with your username.
Bootable sierra usb. That just allows your user to execute the sudo mount command without having to supply a password. You can save the file with CTRL + O, confirm and exit with CTRL + X.
For the purposes of this article, we'll cover Zoom, Skype, and Hangouts, in particular. How to Use Snap Camera Filters on Zoom To use Snap Camera, your computer needs to be running at least Windows 7 or macOS 10.12 and have a working webcam. Hangouts app osx. You can play YouTube videos and others within the app, so you don't need to embed code or anything. With inline bots, such as @gif, @pic/bing, @vid/YouTube, etc, you can look things up without leaving the client or chat that you're in. Simply type the name and some keywords and wait for the results to load.
Mission complete. You're all set to win at life by using Docker for Windows and WSL.
Let me know how it goes in the comments!
Estimated reading time: 4 minutes
Docker Desktop provides several networking features to make it easier touse.
Features
VPN Passthrough
Docker Desktop networking can work when attached to a VPN. To do this,Docker Desktop intercepts traffic from the containers and injects it intoWindows as if it originated from the Docker application.
Port Mapping
When you run a container with the -p argument, for example:
Docker Desktop makes whatever is running on port 80 in the container (inthis case, nginx) available on port 80 of localhost. In this example, thehost and container ports are the same. What if you need to specify a differenthost port? If, for example, you already have something running on port 80 ofyour host machine, you can connect the container to a different port:
Windows Docker Running Linux
Now, connections to localhost:8000 are sent to port 80 in the container. Thesyntax for -p is HOST_PORT:CLIENT_PORT.
HTTP/HTTPS Proxy Support
See Proxies.
Known limitations, use cases, and workarounds
Windows Docker Run -v
Following is a summary of current limitations on the Docker Desktop for Windowsnetworking stack, along with some ideas for workarounds.
There is no docker0 bridge on Windows
Because of the way networking is implemented in Docker Desktop for Windows, you cannotsee a docker0 interface on the host. This interface is actually within thevirtual machine.
I cannot ping my containers
Docker Desktop for Windows can't route traffic to Linux containers. However, you canping the Windows containers.
Per-container IP addressing is not possible
The docker (Linux) bridge network is not reachable from the Windows host.However, it works with Windows containers.
Use cases and workarounds
There are two scenarios that the above limitations affect:
I want to connect from a container to a service on the host
The host has a changing IP address (or none if you have no network access). We recommend that you connect to the special DNS namehost.docker.internal which resolves to the internal IP address used by thehost. This is for development purpose and will not work in a production environment outside of Docker Desktop for Windows.
You can also reach the gateway using gateway.docker.internal.
If you have installed Python on your machine, use the following instructions as an example to connect from a container to a service on the host:
Run the following command to start a simple HTTP server on port 8000.
python -m http.server 8000If you have installed Python 2.x, run
python -m SimpleHTTPServer 8000.Now, run a container, install
curl, and try to connect to the host using the following commands:
Windows Docker Run Command
I want to connect to a container from Windows
Port forwarding works for localhost; --publish, -p, or -P all work.Ports exposed from Linux are forwarded to the host.
Our current recommendation is to publish a port, or to connect from anothercontainer. This is what you need to do even on Linux if the container is on anoverlay network, not a bridge network, as these are not routed.
The command to run the nginx webserver shown in Getting Startedis an example of this.
To clarify the syntax, the following two commands both publish container's port 80 to host's port 8000:
To publish all ports, use the -P flag. For example, the following commandstarts a container (in detached mode) and the -P flag publishes all exposed ports of thecontainer to random ports on the host.
See the run command for more details onpublish options used with docker run.
