One way that ARM could make inroads into server work would be a robust and efficient Java implementation as Java seems to be the most portable thing out there for development. Java doesn't give you the best performance though and there are pretty big limits in what you can do with low-level stuff to improve performance.