We definitely know less than we think, there's a lot of conjecture paraded as fact in popular histories. The case of Trajan's forum also illustrates the dangers of reconstruction, the 'markets' have been so well established as fact it's almost impossible to reverse it. It's not enough to just change the text on a sign when the buildings so obviously look like shops.