For me the name Byzantine Empire it's something like a phase of the roman state like Late Republic or Principate and NOT the name of a different state.
The roman state was born as a city with some land around in the valley of Tiber and died as a city with some land around in Bosfor.