Fast neutrons are conventionally detected by scintillators of large volume, low spatial resolution and poor, if any, directional sensitivity. In this paper we present a detection technique based on the tracking of protons recoiled by fast neutrons. In this approach we use the silicon pixel detector Timepix attached in contact planar geometry to a fast plastic scintillator. The protons recoiled by neutrons in the scintillator are detected by the pixel detector while scintillation light is sensed by a 4×4 array of silicon photomultipliers (SiPM). Each photomultiplier is equipped with an independent amplifier and discriminator providing a fast trigger signal to the pixel detector. Variable threshold level allows adjustment of the trigger sensitivity. Single events in the pixel detector can be tagged and triggered by the scintillating detector. Position and energy sensitivity of the scintillator together with the position and the energy sensitivity of the pixel detector allow obtaining information about the position and the spectrum of the neutron source. The Timepix detector is operated with the FITPix readout interface and the Pixelman software package providing control, DAQ and online visualization. The assembled prototype has been tested with fast neutrons from a laboratory radioactive source (AmBe) and a Van de Graaff accelerator (D-T reaction). The detector architecture, comprising the Timepix device, the scintillator and the segmented SiPM, allows stacking several such units for increased detection efficiency and enhanced directional sensitivity.