Efficient detection of nonclassicality using moments of the Wigner function

States with a negative Wigner function, a significant subclass of nonclassical states, serve as a valuable resource for various quantum information processing tasks. Here we provide a criterion for detecting such quantum states characterized by a negative Wigner function. Our method relies on evaluating moments of the Wigner function, which involves computing simple functionals and can be implemented in a real experiment without the need for full state tomography or Wigner function reconstruction. We provide explicit examples to support our detection scheme. Further, we propose an experimental method utilizing the mode swap operator to realize these moments in a real experiment.