Good morning. I have an issue with that the robots.txt file is not recognized by google and SimRush. Any ideas why? (https://server2.designrus.dk:8080)
If you mean this file: https://server2.designrus.dk:8080/robots.txt it should be fine. I see it is crawled on Google, you can ask them to remove this with their Search Console. The only thing that could be wrong that Agent is with a upper A, while it is usually typed with a lower a. not sure if that would cause problems.
Alright, please let me know If it does, I will change this so we can include it in 3.2.1. By the way, editing it won't remove the listing right away. This can take some time.
