The aim of this project is to design inertial sensor based activity recognition for a low power continuous sensing architecture for today's mobile technology using a dedicated low-power sensor processor. The system framework is designed to provide higher level access to sensors and run sensor based algorithms. The sensor processor can provide consistently low latencies for feedback and interaction and continuous low power sensing for context adaptive user interfaces. In the current state of the art of hand-helds, every sensor is interfaced to the host processor directly and all the sensory data preprocessing and event detection is performed at the expense of the host processor. A dedicated sensor processor with good system architecture would improve the power and processing efficiency.