Lipo Battery and Battery Babysitter to power Arduino ESP32

I am realizing that the maximum output of the Battery Babysitter connected to a 3.7V battery is not high enough to power an Arduino ESP32. Is there anything I can implement so that it gets at least 6V?

Edit: Would a Buck Boost Converter be sufficient?