I'm happy to report that I was able to remove the factory amp, and install everything as I intended from the start.
System working short clip here:
https://youtu.be/lX69HM0nZR0
Excuse the wiring mess, shouldn't have started this after work. I'll be posting a full write up on the original post once I clean it up and can get a few good diagrams written up.