Export on a proper machine and edit:
Dism /Online /Export-DefaultAppAssociations:\\Server\Share\AppAssoc.xml
Then do the GPO thing: Open your Group Policy editor and go to the Computer Configuration\Administrative Templates\Windows Components\File Explorer\Set a default associations configuration file setting.