As long as the UI.exe is running, it will continue to monitor toon names from anarchy online.
Don't need to have the manage window open.
Manually selecting anarchy online works, the auto-detect is just for convenience, detects AO if its already running.
Edit: Mini tutorial available at http://ribbs.me/wiki/ao/minitutorial/
Let me know if this doesn't help