Resolved with capacitors and 22ga wire.
The LD1117S33 (if authentic) needs minimum of input 0.1uF and output 10uF capacitors.
Also, do not use thin power supply wires. I recommend minimum of 22 Ga.
Okay, I added 47uF and 220uF capacitors to my circuit (on Vin and Vout of the LD1117 respectively) and swapped all the wires for 22 gauge. And... it works! Boots up completely and was able to setup wifi through web config and so on. Thank you!
what does your 3.3 regulator deliver as far as max amps?
According to datasheet: max 800mA.