Powershell Remote Execution not working?

I'm new to Solarwinds products so bear with me, hopefully this is something stupid and easy

I've got a powershell monitoring script I need to run on a few nodes, but it isn't executing at all. In the Powershell Monitor template Edit Script field, if I choose the node and click Get Script Output, it just returns the output result "Not Defined".

Things I've tried:

If I change Execution Mode to Local Host, the script returns output correctly but I do need this to run on the remote host.

If I choose another node that has other powershell scripts remotely executing correctly, it works fine. This tells me the problem is specific to these new nodes.

If I open up powershell on the orion server and run Invoke-Command -ScriptBlock {hostname} -ComputerName <node>, it works correctly.

When I run wireshark on the working and non-working nodes, I can see the traffic coming in on port 5985 when running invoke-command. When testing from orion's Get Script Output, I only see traffic on the working node.

I've run winrm quickconfig on the problem nodes

Any idea what misconfiguration might cause this?