You can switch off the application's logs in the Arduino IDE. It is not the boot log that is slowing things down generally (and that is turned off with a hardware setting, not software). If you need the shortest boot cycle possible, you can disable verifying the image, which can get your bootloader time under 25ms. That is an sdkconfig option pre-set in arduino-esp32.
arduino-esp32 includes compiled versions of the esp-idf in order to speed up and simplify the compile. You need to recompile those libraries in order to change these embedded options. You can use the template to set up a build environment with arduino as a component. It would be hard to get a consistent sdkconfig without menuconfig, and you will likely want to use menuconfig to determine what options you need to change for different variants.
It is also possible to compile arduino as an IDF component in platformio using both the arduino and esp-idf frameworks (framework = arduino, espidf).
The Arduino IDE is simply not set up to support such a feature.

If you need to tweak the IDF configuration you can either use Arduino as a component or manually recompile the libs using https://github.com/espressif/esp32-arduino-lib-builder

As already said, Arduino IDE uses precompiled libraries and it is not possible to change any sdkconfig setting.
A way to use Arduino and be able to change the sdkconfig is by using Arduino as IDF Component.
It will allow to build the Arduino project using IDF tools, such as idf.py build and idf.py menuconfig

Related to the itme it takes to boot: Does your project use PSRAM?
Arduino checks the whole memory (scanning it) before starting the sketch.
There is a way to skip it (that takes about 500ms).
For not testing PSRAM, just add BYPASS_SPIRAM_TEST(true); in the sketch code.

#5737 (comment)
#6135