We propose a new concept that facilitates networking of smart objects by creating topologies that reflect the physical environment. As the objects are clustered according to their physical relationships we obtain a self-organizing, scalable and fault-tolerant peer-to-peer like network. We present the ideas and benefits of this concept and our ongoing work that implements the detection of the relationships between a load-sensing table and sensor-augmented objects.