You actually can use the 4.25 GiB at the end without any reboot, because Linux supports on-line partition resizing since kernel 2.6 (meaning you can resize partitions while they're mounted, even the root partition, without any reboot).

I'll show you how to remove the swap partition and extend the root partition with all the free space at the end. Then I'll use the unallocated space in the beginning (14.35 GiB) for a new swap partition. Of course 14.35 GiB is a bit much so you can also choose to use some to extend your NTFS partition.

1. Open GParted

   
   



2. Right click on /dev/sda11 and select Swapoff

   
   



3. Right click on /dev/sda11 and select Delete

   
   



4. Click on Apply All Operations

   
   



5. Open a terminal

   
   



6. Extend the root partition:

   
   

   sudo resize2fs /dev/sda10
   
   

   
   



7. Go back to GParted

   
   



8. Open the GParted menu and click on Refresh Devices

   
   



9. Right click on the unallocated space and select New

   
   



10. Select linux-swap as file system

    
    



11. Click on Add

    
    



12. Click on Apply All Operations

    
    

Initially I wrote this using the command line only, but then I decided to try to use GParted as much as possible as this may be easier for you to see what's going on. You may even extend the root partition using GParted. But you need to unmount your root partition before you work on it. I mean you should work offline (using a liveUSB). In some cases your grub may get damaged. So do reinstall your grub before you leave out from your offline working.

I believe GParted will automatically enable the new swap partition but I'm not sure. You can always check by right clicking on it and then selecting Swapon. If this option is not available the swap partitions is probably already enabled.

Also the Refresh Devices step is probably unnecessary, but you should follow it just to be sure.

We cannot resize the extended partition (sda4, in this case) as it has a mounted logical partition within it. So we need to boot into the live mode of an Ubuntu USB/CD drive. From there, start GParted, turn off swap if necessary, right click on the extended partition and resize it to suit your needs. Then, follow the steps mentioned as needed to resize root and add back swap. In the event that your root partition UUID gets changed, you can update Grub by executing these steps in the live mode:

sudo mount /dev/sda10 /mnt 

sudo mount -o bind /dev/ /mnt/dev 

sudo grub-install --root-directory=/mnt /dev/sda 

sudo chroot /mnt /bin/bash 

# Now within the chroot

sudo update-grub

exit

# Now outside chroot

The first couple of commands mount the root partition (sda10, in this case) and set up /dev/ for use within a chroot environment. (Other partitions that can be similarly mounted for a more functional chroot are /proc, /sys and /dev/pts.) Then we reinstall grub (not really necessary). Then, we enter the chroot and update grub. This causes grub to use the new UUIDs where necessary. After exiting the chroot, reboot and we should get the grub menu back.