highlight-sexp-mode add-hook with (highlight-sexp-mode 0)

[Heime]

I am using highlight-sexp-mode with the following in my init file

(add-hook 'emacs-lisp-mode-hook 'highlight-sexp-mode)

But then I also call  

(if highlight-sexp-mode (highlight-sexp-mode 0))

Yet when I load an ".el" file, I still get "highlight-sexp-mode" activated.