I find Ubuntu 64bit to be a little slow on my notebook with a Core i5 and 2 GB of RAM. Especially alt+tab takes some time to show up sometimes.
I mostly run Chromium, Thunderbird, LibreOffice Writer, Banshee and pdfviewer. Right now I'm just running the first two plus UbuntuOne in the background and there's 87% RAM used.
Should I upgrade to 4 GB?