Upwind vs downwind shores

[tweedwolfscream]

Being a city-based shore angler, I often fish off vertical concrete harbour/quay walls or piers that face a fairly well-defined direction. In these cases, when the shore/wall faces upwind (eg the downwind side of a quay), there's always a mat of floating plant matter etc covering the first few meters of surface. If you're fishing off the upwind side of the quay facing downwind, the surface of the adjacent water is relatively clear. The latter position is of course better from the perspective of being able to move your tackle around freely and not dragging big wads of greenery.

My question is, does the weed-choked downwind side of a waterbody have advantages for actual fishing success over the upwind side? Does the same wind that moves floating junk to one also move forage to the same side and attract fish? In other words, should I suck it up and fish the annoying floating mats for the sake of better chances?

For purposes of argument let's assume that I'm talking about gentle enough winds to not seriously impact casting, and that actual living weed structure is equal in all spots.