That's because it was built without a serious purpose in mind. It's more a "proof-of-concept" toy than anything else. Had the developers been serious about real content generation, you'd probably see what you're describing. Bear in mind that there's an ungodly amount of work involved in serious content automation too. And by the looks of what this GPT2 thing generates, the people who made it took the easy route.