I suspected as much. That was also why I didn't start with Amnesia: The Dark Descent. Maybe I'll look for some lighter/shorter game to start with.
I may know a few horror games that aren't scary or too scary per se, but still are pretty good imo:
Not too long ago I finished the game "Mothered - A Role-Playing Horror Game".
Don't let the primitive graphics and level design fool you, it actually adds to the uncanny atmosphere of the game.
There's "House of Ashes", which imo wasn't really scary but still fun to play.
It's more of a choose your own adventure "movie", but still can get tense at times because you'll likely want to make sure all the main characters survive and get the best ending. It's got quick-time events in it though, which is not everyone's cup of tea.
Though I think such mechanisms in these kinds of games fit in well.
There's "Buddy Simulator 1984"
A game where you get your own virtual buddy and become BFF's.
The story's really good.
As a Junji Ito fan and someone with a soft spot for pixel graphics/retro styled games, I'd also like to mention "World of Horror".
It's still in early access and development is slow though, but very much playable.
Oh, and "Pamali" may be worth mentioning too.
It's a small exploration game where you have to respect the customs according to Indonesian tradition, lest you might **** of the spirit that haunts the place.