A user kindly posted an answer and linked to this reddit post which contains a workaround to fix this issue. He somehow deleted his answer after a few minutes. I found my workaround at the end of the mentioned reddit-post which is a one liner!

What solved my issue was the workaround explained in this link.
what I did was to simply run the following command :
First I used this command :

pacmd load-module module-alsa-sink name='Front Panel Headphone' device=1 device_id=2 control='PCM',1

which didnt work, but after running the following command the fornt jack started working just fine:

pacmd load-module module-alsa-sink device=hw:Audio,1 control='PCM',1

the device name had to be hw:Audio, as I got that from running alsa-info
(here's my info for the reference)

!!Soundcards recognised by ALSA

!!-----------------------------



 0 [PCH            ]: HDA-Intel - HDA Intel PCH

                      HDA Intel PCH at 0x4014218000 irq 184

 1 [NVidia         ]: HDA-Intel - HDA NVidia

                      HDA NVidia at 0x85080000 irq 17

 2 [Audio          ]: USB-Audio - USB Audio

                      Generic USB Audio at usb-0000:00:14.0-2, high speed

After that, I noticed a new entry in the settings/sound section, and both the front and back have sound thankfully.