Don't worry, you are definitely not the only casual player on the server.
There are quite a bunch in my own kinship and no doubt in many other non-raidingfocussed kins.
I guess it is quite hard to encounter other casual middle-earth walkers in a gameworld as big as ours. especially when you are not in a kinship and tend to keep to yourself.
If you want a higher chance to encounter other players spend some more time in Bree, Snowbourn or Forlaw. Or join a kinship if you haven't done so yet .
[B][URL="https://www.lotro.com/forums/showthread.php?385713-Kinship-Revamp-Proposal"][COLOR=#ed2669]A vote for the kinship revamp proposal is a vote for progress! Vote today![/COLOR][/URL][/B]