When you have multiple HTML documents open, the Close All command (accessed
by holding down SHIFT while choosing the File menu) closes only the current
document instead of all open documents.
Close each of the HTML documents individually.
Microsoft has confirmed this to be a problem in the Microsoft products
listed at the beginning of this article.