Absent Member.
Absent Member.
1597 views

Preserving Consecutive Whitespace

I've just started down the road of IDM, and I've run into my first real stumbling block.

I'm trying to pull data into my identity vault from our student records system using a delimited text driver. I have a particular attribute that can potentially contain consecutive spaces that need to be preserved. At some point, as the data makes its way into the system, the records that do have consecutive spaces end up having those consecutive spaces consolidated into a single space.

I have a feeling that this is a very simple problem with a very simple solution, and that I'm just missing a checkbox somewhere.

Any thoughts?
Labels (1)
0 Likes
11 Replies
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

ccalvert wrote:

>
> I've just started down the road of IDM, and I've run into my first
> real stumbling block.
>
> I'm trying to pull data into my identity vault from our student
> records system using a delimited text driver. I have a particular
> attribute that can potentially contain consecutive spaces that need
> to be preserved. At some point, as the data makes its way into the
> system, the records that do have consecutive spaces end up having
> those consecutive spaces consolidated into a single space.
>
> I have a feeling that this is a very simple problem with a very simple
> solution, and that I'm just missing a checkbox somewhere.


Can you post a sanitized level 3 trace?

My best guess (without a trace) is that the input stylesheet has a
normalize-space that is triggering this behaviour. I'd start looking at
this as a first point.
Alex McHugh - Knowledge Partner - Stavanger, Norway
Who are the Knowledge Partners
If you appreciate my comments, please click the Like button.
If I have resolved your issue, please click the Accept as Solution button.
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace


Alex right, trace can help to troubleshoot the issue.
By "default" all attribute values supposed to be imported to Vault as
is.


--
If you find this post helpful, please show your appreciation by clicking
on the star below :cool:
------------------------------------------------------------------------
al_b's Profile: https://forums.netiq.com/member.php?userid=209
View this thread: https://forums.netiq.com/showthread.php?t=56126

0 Likes
Highlighted
Absent Member.
Absent Member.

Re: Preserving Consecutive Whitespace

That is exactly what was happening. The input stylesheet had <xsl:variable name="fieldValue" select="normalize-space(.)"/> by default. I changed it to <xsl:variable name="fieldValue" select="."/> and everything seems to be coming through as expected now.

Thanks for pointing me in the right direction.
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

ccalvert wrote:

> That is exactly what was happening. The input stylesheet had
> <xsl:variable name="fieldValue" select="normalize-space(.)"/> by
> default. I changed it to <xsl:variable name="fieldValue" select="."/>
> and everything seems to be coming through as expected now.
>


I suspected as much, for most use-cases cleaning up potentially messy
delimited text data is the preferred option. Your use-case is an
exception.

> Thanks for pointing me in the right direction.


Glad to help.
Alex McHugh - Knowledge Partner - Stavanger, Norway
Who are the Knowledge Partners
If you appreciate my comments, please click the Like button.
If I have resolved your issue, please click the Accept as Solution button.
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

Another, probably better, option would be to try the Generic File Driver,
which is a free solution from one of the consultants out there. It does
not rely on stylesheets to convert from CSV to XDS and, as a result, would
probably do a much better job with a lot of things (not probably,
definitely) and, oh yeah, still free.

https://www.netiq.com/communities/cool-solutions/cool_tools/generic-file-driver-idm-v-003/

Take the time to switch; you will not regret it in the long term.

--
Good luck.

If you find this post helpful and are logged into the web interface,
show your appreciation and click on the star below...
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

ab wrote:

> Another, probably better, option would be to try the Generic File
> Driver, which is a free solution



Under the new licensing model - I believe that the "free" distinction
is a moot point now as Tools can be bundled in the base license package.

Aside from that Generic File Driver has a learning curve and some of
its own quirks but it is well worth the investment in time.
Alex McHugh - Knowledge Partner - Stavanger, Norway
Who are the Knowledge Partners
If you appreciate my comments, please click the Like button.
If I have resolved your issue, please click the Accept as Solution button.
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

The learning curve for the generic file driver is shorter than the text driver in my book.
I still use it in all instances even if I have the licensing for the text driver.
It's current, updates are quick and it handles more use cases.
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

On 6/26/2016 11:26 AM, joakim ganse wrote:
>
> The learning curve for the generic file driver is shorter than the text
> driver in my book.
> I still use it in all instances even if I have the licensing for the
> text driver.
> It's current, updates are quick and it handles more use cases.


Agreed, Generic File is way easier to use than anything else.

On a side note, I have a package add on now for it that if you want to
use multiple input files, each in a different object class that it can
now handle it.


0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: Preserving Consecutive Whitespace

Cool, need to have a look at that. No current reason, just curious on what path you took.
0 Likes
Highlighted
Absent Member.
Absent Member.

Re: Preserving Consecutive Whitespace

I'll take a look at the Generic File Driver. I'm certainly in favor of easier and better. Right now, I'm still just getting my head wrapped around all of the parts and pieces of IDM and pulling data in and out of a test system, so it should be trivial to change drivers.

Thanks, everyone!
0 Likes
Highlighted
Micro Focus Expert
Micro Focus Expert

Re: Preserving Consecutive Whitespace

On 25.06.2016 00:16, ccalvert wrote:
>
> That is *exactly* what was happening. The input stylesheet had
> <xsl:variable name="fieldValue" select="normalize-space(.)"/> by
> default. I changed it to <xsl:variable name="fieldValue" select="."/>
> and everything seems to be coming through as expected now.


Note that when comparing strings via LDAP, the protocol requires servers
to apply "Insignificant Space Handling" rules
("https://tools.ietf.org/html/rfc4518#section-2.6.1).
If that causes issues with your data, use an attribute type that has
octect string syntax.


--
Norbert
--
Norbert
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.