So I ended up getting it to work with the Arduino AVR Boards 1.8.6, it would not work with 1.6.21 or 1.6.22, I'll see if it continues to behave.
Zac
Edit: I also ended up compiling with the IDE 1.8.19 bundled library and not the ones included with the firmware.
Zac
Edit: I also ended up compiling with the IDE 1.8.19 bundled library and not the ones included with the firmware.

