It's a start, but measuring actually means nothing. It could be perfectly 5V without a load and as soon as a load/box is connected, it may drop down quite a bit. And even if the Voltage is good, it may not be able to provide enough current.
5V power supplies are typically common (and most with Center positive), so if you have another 5V power supply (rated at least 2A), you can try to swap it (assuming barrel fits).