I love tips that help us use MS Word more effectively. Nerino Petro at Compujurist has a great little post detailing how to take the last bit of text that appears by itself on the last page and squeeze it into the previous page. Not only does Nerino share this tip, but he also tells us how to do it in both Word 2003 and Word 2007.
I would note that you should be wary of trying this on briefs that are filed with courts that enforce strict page limits and font sizes. Word adjusts the font sizes to repaginate the document.
If you need to solve this problem, jump over to the post and see the details. I will give you a hint. The Print Preview feature plays an important role.