Locktite blue is made to work with metal. To glue that cap in place you would need to use a glue that's made for use with plastic.
One problem i can see with using glue, If you glued it in place, you could easily strip out that screw driver slot in the end of the cap if you ever have to remove it.
Holding that cap in place with a screw MADE FOR USE with plastic, would allow you to easily remove it. Just my 2 cents, YMMV.
You may find the link i posted below helpful, if you decide to try the glue route.
Fixing plastic objects requires the best glue for the job. Read our instructions and find the best super glue for use with all types of plastic.
www.loctiteproducts.com