Uncaught exception in SpoolDirectorySource thread. Restart or reconfigure Flume to continue processing.

Error Message :

15/06/18 16:00:29 ERROR source.SpoolDirectorySource: FATAL: Spool Directory source xxxxxx: { spoolDir: /root/Documents/FlumeWorkSpace/amsInput/ }: Uncaught exception in SpoolDirectorySource thread. Restart or reconfigure Flume to continue processing.

java.lang.NullPointerException

        at com.interceptor.AMSLogParserInterceptor.intercept(AMSLogParserInterceptor.java:34)

        at com.interceptor.AMSLogParserInterceptor.intercept(AMSLogParserInterceptor.java:52)

        at org.apache.flume.interceptor.InterceptorChain.intercept(InterceptorChain.java:62)

        at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:146)

        at org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:236)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

Reason :

·         Because of corrupted file which you loading, problem with your custom interceptor written by you.

·         Duplicate files loading