Question Running accelerated DL on M1/M2 chipset Macs

Save the headache, get an Intel x86 PC + NVidia GPU - a standard AI/ML/DL setup - and setup the PC at home. With todays' broadband speed/5G, just remote back into your PC for your AI/ML workloads.

This is my current setup: Macbook Air -> wireguard vpn back home -> intel PC+NVidia GPU over RDP. Very usable.

I get the best of both worlds. Long battery life, standard Windows/Linux AI desktop powered by a beefy GPU.

@laurenceliew Beowulf thanx. Actually I am asking on behalf of many mac enthusiasts who were sold into how cool (in celsius) the new Mx chips are.

And they are exclusive Mac users

@peterleong haha... same situations for the AMD enthusiasts... until they find out their peers can run the same AI/ML code 10-100X faster on similarly spec'ed INTEL systems... all because of Intel MKL.

You CAN run on AMD and M1/M2 systems - but the software ecosystem for AI/ML is a lot weaker, and you have to build (re-compile) a lot of the core libraries yourself. If you enjoy doing such stuff - please go ahead.

If you want to just fire and forget, and focus on your AI/Ml code, the easiest path is to use a well supported ecosystem of hardware and software tooling for AI/ML workloads today.

Use the right tool for the job. 

I would recommend the setup provided by @laurenceliew for best performance, but if one really needs to run TF2 and Pytorch on M1/M2 chips, I recommend to do a read up on the following sites:

TF2 on Metal:
removed link

Pytorch (Nightly) on Metal:
removed link

I highly recommend using miniconda to manage dependencies instead of pip as building packages such as numpy and pandas will be a hassle. This is taken from the TF2 on Metal site:

Download and install <a href=" removed link ">Conda env:

chmod +x ~/Downloads/Miniforge3-MacOSX-arm64.sh
sh ~/Downloads/Miniforge3-MacOSX-arm64.sh
source ~/miniforge3/bin/activate

@laurenceliew Hi Laurence, long time, hope all is well. Very innovative set up !

 Side tracking here, do you then run the projects on a VM or windows(or your PC is a linux os?) directly?

I have both Windows and Linux VMs.  They are hosted on a single PC running Proxmox OS.. It is a very nice and virtualization hosts with a comprehensive web-based management interface. It's KVM so supports GPU pass thru and I can assign my GPU to my VMs as required.