The way to fix it is using pip.

The way to set up pip is described here: http://docs.python-guide.org/en/latest/starting/install/linux/#install-linux and it sums up to:

(I think python-distribute comes pre-installed in 13.10, but it doesn't hurt to check)

sudo apt-get install python-distribute

Then we set up the python environment properly:

sudo easy_install pip

sudo pip install virtualenv

After that, do:

sudo pip install ipython[all]

This will let pip take care of the dependencies listed by ipython. At this point, IPython is already working properly.

OPTIONAL, installing matplotlib and numpy:

These take care of the dependencies for matplotlib and numpy (and assuming you already have LaTeX properly installed):

apt-get install libfreetype6-dev libpng-dev libpython-all-dev gcc gfortran dvipdf

partial ref: https://stackoverflow.com/questions/8359383/error-while-installing-matplotlib

I'm aiming for something like this:

    ============================================================================

Edit setup.cfg to change the build options



BUILDING MATPLOTLIB

            matplotlib: yes [1.3.1]

                python: yes [2.7.5+ (default, Sep 19 2013, 13:49:51)  [GCC

                        4.8.1]]

              platform: yes [linux2]



REQUIRED DEPENDENCIES AND EXTENSIONS

                 numpy: yes [version 1.7.1]

              dateutil: yes [using dateutil version 2.1]

               tornado: yes [using tornado version 3.1.1]

             pyparsing: yes [using pyparsing version 2.0.1]

                 pycxx: yes [Couldn't import.  Using local copy.]

                libagg: yes [pkg-config information for 'libagg' could not

                        be found. Using local copy.]

              freetype: yes [version 16.1.10]

                   png: yes [version 1.2.49]



OPTIONAL SUBPACKAGES

           sample_data: yes [installing]

              toolkits: yes [installing]

                 tests: yes [using nose version 1.3.0]



    OPTIONAL BACKEND EXTENSIONS

                macosx: no  [Mac OS-X only]

                qt4agg: yes [installing, Qt: 4.8.4, PyQt4: 4.10.3]

               gtk3agg: yes [installing, version 3.4.8]

             gtk3cairo: yes [installing, version 3.4.8]

                gtkagg: no  [The C/C++ header for gtk (gtk/gtk.h) could not

                        be found.  You may need to install the development

                        package.]

                 tkagg: no  [The C/C++ header for Tk (tk.h) could not be

                        found.  You may need to install the development

                        package.]

                 wxagg: no  [requires wxPython]

                   gtk: no  [The C/C++ header for gtk (gtk/gtk.h) could not

                        be found.  You may need to install the development

                        package.]

                   agg: yes [installing]

                 cairo: yes [installing, version 1.8.8]

             windowing: no  [Microsoft Windows only]



OPTIONAL LATEX DEPENDENCIES

                dvipng: yes [version 1.14]

           ghostscript: yes [version 9.10]

                 latex: yes [version 3.1415926]

               pdftops: yes [version 0.24.1]

So, if I just missed any dependencies, just comment below ;)

Then, using pip:

sudo pip install matplotlib[all]

It compiles, and done. Ipython, numpy and matplotlib ready for science in Ubuntu 13.10.