Pretty hard to have a full time job and go the extra mile, as suggested by colleagues here. I've been in the same boat and I had to rethink my way of life. Not that yours doesn't look well, it really does. The problem is when you come back from work or you finish your full time job, you're too exhausted to perform. Not saying work, because there's a huge difference between working and performing - sometimes you do in 2 hours more than you achieve in one full day.
For me, waking up in the early morning worked. 4-4:30, around this time. It is quiet, I'm well rested. It became a habit pretty quickly and it felt better. That's how you solve more of your side stuff, and you don't have to lose your job - your different jobs have particular psychological processes behind - motivation and habit are the most important. So point scored here.
There's no perfect scenario, there are downsides regardless your schedule. Mine forced me to go to bed at 8-9 in the evening. But it does make a difference.
Diet plays an important part. Some will laugh, but I've seen some notable differences based on what I eat, too.
There's no success without sacrifices, as someone said above. No pain, no gain, as they all say. And success is directly proportional to the amount of suffering, that's a golden rule, sometimes.