No, it's not wrong, and I encourage you to read the light novel because you get more of the story.
Yes, binge read the novel. You won't regret it.
You won't regret it, unless you want a happy/good/relativelydecent ending.
What do you think?