Highly Recommend getting one of the +20 back IM pieces that gives armor. If you don't; this is how I did it: Have a lot of cake ready. Place down spells that do dmg over time and other than that only use attacks that doesn't lock you in an animation for very long (unless you know you can get away with it). Keep the boss close to either side of the room and try not to corner yourself. You want to leave yourself with a lot of room to run away from the insane orbs, You can't dodge them, but they only travel so far. Having a bit of luck helps tremendously as well.
I haven't solo'd him as Specialist at your level, yet, but I might try it soon.
Trying to solo hard bosses with low gear is some of the most fun aspects of this game, in my opinion, but as the others have said, maybe going as a group is best for now.