Highlighted
Niemand.Richard1 Absent Member.
Absent Member.
467 views

Flex Connector agent[0].<attribute> Help

Hi Guys

I am doing my nut trying to get a FlexConnector working, with a few files using a Regex file processor to watch 2 files (in 2 different modes).

The first file is a locked file that is written to randomly and watched in realtime mode (this works 100's).

The second file however is a generic log file which is only locked when writing to it, and is being processed in batch mode (this is messed up). I generate a couple of lines to the log file and the agent sees it, processed the lines, but does not submit the events forward.

[2011-12-02 10:02:53,579][INFO ][default.com.arcsight.agent.util.x][processFile] Found file [\\fpricniem1\c$\LOGS\Log-O-02.log] will wait for at least [1000] to start processing.
[2011-12-02 10:02:58,585][INFO ][default.com.arcsight.agent.util.x][processFile] Processing file [\\fpricniem1\c$\LOGS\Log-O-02.log]
[2011-12-02 10:02:58,585][INFO ][default.com.arcsight.agent.ci][fileStarted] Started processing file [Log-O-02.log]
...
[2011-12-02 10:02:58,608][INFO ][default.com.arcsight.agent.sdk.a.p][init] Successfully Parsed properties from file [type-o-extra]
[2011-12-02 10:02:58,609][INFO ][default.com.arcsight.agent.sdk.a.p][init] Successfully Parsed properties from file [type-o]
[2011-12-02 10:02:58,617][INFO ][default.com.arcsight.agent.baseagents.b.k][start] Successfully started non-locking windows file reader for the file[\\fpricniem1\c$\LOGS\Log-O-02.log]
[2011-12-02 10:02:58,618][INFO ][default.com.arcsight.agent.baseagents.b.e][createStreams] Created input stream for the file[\\fpricniem1\c$\LOGS\Log-O-02.log] successfully.
[2011-12-02 10:02:58,618][INFO ][default.com.arcsight.agent.baseagents.b.e][createStreams] Created all streams/readers for the file[\\fpricniem1\c$\LOGS\Log-O-02.log] successfully.
[2011-12-02 10:02:58,620][INFO ][default.com.arcsight.agent.baseagents.b.e][FileReaderThread] File[\\fpricniem1\c$\LOGS\Log-O-02.log] has an initial size[44505]
[2011-12-02 10:02:58,620][INFO ][default.com.arcsight.agent.baseagents.b.e][startAt] Attempting to start the file reader at byte offset[-1], char offset[-1] with crc32[-1], remnant[null]
[2011-12-02 10:02:58,623][INFO ][default.com.arcsight.agent.baseagents.b.e][start] Successfully started the file reader for the file[\\fpricniem1\c$\LOGS\Log-O-02.log] with startatend[false]
[2011-12-02 10:02:58,623][INFO ][default.com.arcsight.agent.baseagents.h.b][processFile] Batch processing started for file[\\fpricniem1\c$\LOGS\Log-O-02.log]
[2011-12-02 10:02:58,624][INFO ][default.com.arcsight.agent.baseagents.b.k][close] Terminating the non-locking windows file reader for file[\\fpricniem1\c$\LOGS\Log-O-02.log]
[2011-12-02 10:02:58,624][INFO ][default.com.arcsight.agent.baseagents.h.b][processFile] Batch processing finished for file[\\fpricniem1\c$\LOGS\Log-O-02.log], elapsed time[0w 0d 0h 0m 0s 1msec]
[2011-12-02 10:02:58,624][INFO ][default.com.arcsight.agent.ci][fileEnded] Finished processing file [Log-O-02.log]. Status: success
[2011-12-02 10:02:58,633][INFO ][default.com.arcsight.agent.util.x][run] 1 files processed
...


The config for the non-submitting file looks like this...

agents[0].foldertable[1].badsubfolder=bad
agents[0].foldertable[1].configfile=type-o
agents[0].foldertable[1].configfolder=C\:\\ArcSight\\Connectors\\MultiFolder\\Custom\\current\\user\\agent\\flexagent\\
agents[0].foldertable[1].configtype=sdkrfilereader
agents[0].foldertable[1].encoding=
agents[0].foldertable[1].extractfieldnames=
agents[0].foldertable[1].extractregex=
agents[0].foldertable[1].extractsource=File Name
agents[0].foldertable[1].fixedlinelength=-1
agents[0].foldertable[1].fixedlinelengthcontains=Fixed Number Of Characters
agents[0].foldertable[1].folder=\\\\fpricniem1\\c$\\MGS-Log\\
agents[0].foldertable[1].followexternalrotation=false
agents[0].foldertable[1].maxretries=-1
agents[0].foldertable[1].minfilelenght=-1
agents[0].foldertable[1].mode=RenameFileInTheSameDirectory
agents[0].foldertable[1].modeoptions=processed
agents[0].foldertable[1].monitoringinterval=-1
agents[0].foldertable[1].processfoldersrecursively=false
agents[0].foldertable[1].processinglimit=256
agents[0].foldertable[1].processingthreshold=-1
agents[0].foldertable[1].processingtimeout=-1
agents[0].foldertable[1].retryinterval=1000
agents[0].foldertable[1].sleeptime=5000
agents[0].foldertable[1].triggerextension=.done
agents[0].foldertable[1].usealternaterotationdetection=true
agents[0].foldertable[1].usefieldextractor=false
agents[0].foldertable[1].usenonlockingwindowsfilereader=true
agents[0].foldertable[1].usetriggerfile=false
agents[0].foldertable[1].wildcard=Log-O-02.log
# changed true -> false
agents[0].foldertable[1].preservestate=false
# <---
# changed realtime -> batch
agents[0].foldertable[1].processingmode=batch
# <---
# changed true -> false
agents[0].foldertable[1].startatend=false
# <---
# changed 10000 -> 1000
agents[0].foldertable[1].delay=1000
# <---

Can anyone see what I am doing wrong here?

Labels (2)
Tags (2)
0 Likes
Reply
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.