Yes there is. There is no point in doing so because the list will be reordered each time you connect to a new world.
If you really want to mess with it. You need to edit:
C:\Users\User_name\AppData\Loc al\Turbine\The Lord of the Rings Online\Launcher\LauncherUserSe ttings.XML
Make a save copy. I believe you need to remove the following lines:
<World Name="Meneldor" LastUsedDateTime="634640044557 155562" />
Since you connect to more than one world, you will have additional lines
Unless stated otherwise, all content in this post is My Personal Opinion.