D-Link DIR-655 :: Poor Download Speeds While Uploading?

I have a DSL connection with AT&T.  It is rated at 6Mbps / 768Kbps, but it closer to 4Mbps / 600Kbps.  I have a speed stream 5360 connected to the DIR655.  Devices on my network are primarily wireless and include; several laptops, a desktop (which is wireless n), a couple phones / Ipods and a Wii that I watch Netflix on.

I do a lot of Photography and a handful of video work, and backup / share everything online.  When I am uploading photos, even with "conserve bandwidth" turned on in the uploading application, browsing sites is very slow, but reasonably functional.  If I try to upload a video to YouTube, I can barely manage to do anything else the entire time it is uploading.  I've tried to plan and run all my uploads overnight, but then Netflix is unusable when I want to watch it at night.

I've tried several different things, first off, with getting the Wii to function for Netflix, I turned on the QOS engine, for the IP that is assigned to it, and set it to priority 1 for all ports.  I also have a entry in the QOS engine for SSH on port 23 with a priority of 10 because of how laggy my SSH sessions are.  I do not have any other entries in the QOS engine, is that a problem?  Should there be entries that cover other services and assign them a lower priority? 

I have enable traffic shaping and Automatic uplink speed turned on.  It measured the uplink speed at 695kbps, which is pretty accurate.  I have Automatic Classification off, and Dynamic Fragmentation on.  WISH is enabled also. I'm set to mixed n, g, and b, I'm not positive, but I do think my older laptops only use wireless b.

Even more importantly than the Netflix would be to allow me to use the Internet in a functional manner while I am uploading, that would solve a lot of problems.  It seems that the uploads just hog every last bit of upload bandwidth and don't want to make room for even the small requests that one needs to send to view a web page.