Well to be fair the Riddler isn't really what you would call a battle hardend fighter. So taking him down after getting near him wouldn't be that difficult. I wouldn't expect the side missions to be as difficult as the main plot anyway but some of them where interesting. Probably the Zsas telephone one was hardest for me because I hadn't bothered unlocking the grapple boost yet which looking back would have made things ALOT easier.