I regard consciousness as fundamental. I regard matter as derivative from consciousness. We cannot get behind consciousness. Everything that we talk about, everything that we regard as existing, postulates consciousness.
As quoted in The Observer (25 January 1931)
Here is another way to look at it:
You see a hedge against the background of hills.
You see the hills against the background of sky.
But you see the sky against the background of consciousness.
So essentially, you're seeing everything against the background of consciousness.
It's just that consciousness is kind of a passive background, while what you are observing is in the foreground, and it is the foreground which you focus on, just as a fish does not know it is in the sea, and is focused on finding food. You don't notice consciousness as being the field within which everything is experienced. When one's attention is shifted from the foreground to the background, it becomes clear that the background is the default state, and that what is in the foreground, ie, 'the universe', comes out of it.
When you say that matter is a physical thing, you are just regurgitating concept. Reality is not the description of reality. In reality, you don't really know what it is.