Highlighted
Absent Member.
Absent Member.
1521 views

iPrint Appliance V1.0 MySQL running at High CPU utilisation

Hi,

I have configured a POC iPrint Appliance pointing to an AD LDAP Source and I am experiencing a couple of issues.

Firstly, the iPrint Appliance has created around 10,000 of the 17,000 users so I am missing couple of users here.

Secondly, MySQL is running at extremely high CPU utilisation.
1. I have installed vmware tools
2. 2cpu's and 6GB of RAM
3. 2x20GB drives

I would like to take this opportunity to say, "I am impressed". I have configured around 9 printers so far (if all goes well, I'll have another 3991 to go). I have setup a Windows 7 Renderer to test iOS and Android printing via the Novell Mobile iPrint Client and Print to email and the formatting is spot on. I have no issues printing MS Office files and PDF's. Well done Novell.
0 Likes
5 Replies
Highlighted
Absent Member.
Absent Member.

Re: iPrint Appliance V1.0 MySQL running at High CPU utilisation

On 07/24/2013 12:46 PM, zos wrote:
>
> Hi,
>
> I have configured a POC iPrint Appliance pointing to an AD LDAP Source
> and I am experiencing a couple of issues.
>
> Firstly, the iPrint Appliance has created around 10,000 of the 17,000
> users so I am missing couple of users here.
>
> Secondly, MySQL is running at extremely high CPU utilisation.
> 1. I have installed vmware tools
> 2. 2cpu's and 6GB of RAM
> 3. 2x20GB drives
>
> I would like to take this opportunity to say, "I am impressed". I have
> configured around 9 printers so far (if all goes well, I'll have another
> 3991 to go). I have also tested iOS and Android printing via the Novell
> iPrint Client and Print to email. Well done Novell.
>
>



Processor Utilization Increases When 10000 Users Are Imported from
External LDAP Source



When syncing users from an external LDAP source, the processor
utilization increases if you try to import 10000 users.

The reason for this behavior is because the User Sync is scheduled to
run every 8 minutes, by default. Due to this, every time the User Sync
is started, which is every 8 minutes, the processor utilization
increases to around 50%, and remains in that state for up to 5 minutes.
The utilization may further increase if you import over 10000 users.

To workaround this issue, you can change the sync interval by editing
the crontab file.

Launch the crontab file located at /etc/crontab.

Browse to the line where the sync interval is set to 8 minutes.

# run iprint migrate every 8 minutes*/8 * * * * root
/usr/bin/python/opt/novell/iprintmobile/python/migrate/migrateUsers.pyc
>>/var/log/ipmigrate.log 2>&1


Change the time to the desired time interval.

NOTE:For information on scheduling time intervals for cron jobs,
see the article about Cron on Wikipedia.


0 Likes
Highlighted
Absent Member.
Absent Member.

Re: iPrint Appliance V1.0 MySQL running at High CPU utilisation

zos wrote:

> I would like to take this opportunity to say, "I am impressed". I have
> configured around 9 printers so far (if all goes well, I'll have
> another 3991 to go). I have also tested iOS and Android printing via
> the Novell iPrint Client and Print to email. Well done Novell.


Thank you for the positive feedback. It has been passed along. 🙂

--
Your world is on the move. http://www.novell.com/mobility/
We know what your world looks like. http://www.novell.com/yourworld/

Joe Marton Emeritus Knowledge Partner
0 Likes
Highlighted
Absent Member.
Absent Member.

Re: iPrint Appliance V1.0 MySQL running at High CPU utilisat

Thanks Mysterious.
I've made my change in the crontab to much higher value to allow the sync enough time to complete.

I am little confused here. There is a scheduler in iPrint Administration Console, so what is the difference in the sync's between the Administration Console LDAP Import Scheduler and the crontab?
0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: iPrint Appliance V1.0 MySQL running at High CPU utilisation

On 24/07/2013 15:17, Mysterious wrote:

> Processor Utilization Increases When 10000 Users Are Imported from
> External LDAP Source
>
>
>
> When syncing users from an external LDAP source, the processor
> utilization increases if you try to import 10000 users.
>
> The reason for this behavior is because the User Sync is scheduled to
> run every 8 minutes, by default. Due to this, every time the User Sync
> is started, which is every 8 minutes, the processor utilization
> increases to around 50%, and remains in that state for up to 5 minutes.
> The utilization may further increase if you import over 10000 users.
>
> To workaround this issue, you can change the sync interval by editing
> the crontab file.
>
> Launch the crontab file located at /etc/crontab.
>
> Browse to the line where the sync interval is set to 8 minutes.
>
> # run iprint migrate every 8 minutes*/8 * * * * root
> /usr/bin/python/opt/novell/iprintmobile/python/migrate/migrateUsers.pyc
> >>/var/log/ipmigrate.log 2>&1

>
> Change the time to the desired time interval.
>
> NOTE:For information on scheduling time intervals for cron jobs,
> see the article about Cron on Wikipedia.


The above is section 14.12 in iPrint Appliance 1.0 Administration Guide
@
http://www.novell.com/documentation/iprint-appliance1/iprint_appliance/data/b1615jew.html
and I've just spotted a major typo which I'm next going to report.

HTH.
--
Simon
Novell Knowledge Partner

------------------------------------------------------------------------
Do you work with Novell technologies at a university, college or school?
If so, your campus could benefit from joining the Technology Transfer
Partner (TTP) program. See novell.com/ttp for more details.
------------------------------------------------------------------------
0 Likes
Highlighted
Absent Member.
Absent Member.

Re: iPrint Appliance V1.0 MySQL running at High CPU utilisat

Mysterious;2274065 wrote:
On 07/24/2013 12:46 PM, zos wrote:
>
> Hi,
>
> I have configured a POC iPrint Appliance pointing to an AD LDAP Source
> and I am experiencing a couple of issues.
>
> Firstly, the iPrint Appliance has created around 10,000 of the 17,000
> users so I am missing couple of users here.
>
> Secondly, MySQL is running at extremely high CPU utilisation.
> 1. I have installed vmware tools
> 2. 2cpu's and 6GB of RAM
> 3. 2x20GB drives
>
> I would like to take this opportunity to say, "I am impressed". I have
> configured around 9 printers so far (if all goes well, I'll have another
> 3991 to go). I have also tested iOS and Android printing via the Novell
> iPrint Client and Print to email. Well done Novell.
>
>



Processor Utilization Increases When 10000 Users Are Imported from
External LDAP Source



When syncing users from an external LDAP source, the processor
utilization increases if you try to import 10000 users.

The reason for this behavior is because the User Sync is scheduled to
run every 8 minutes, by default. Due to this, every time the User Sync
is started, which is every 8 minutes, the processor utilization
increases to around 50%, and remains in that state for up to 5 minutes.
The utilization may further increase if you import over 10000 users.

To workaround this issue, you can change the sync interval by editing
the crontab file.

Launch the crontab file located at /etc/crontab.

Browse to the line where the sync interval is set to 8 minutes.

# run iprint migrate every 8 minutes*/8 * * * * root
/usr/bin/python/opt/novell/iprintmobile/python/migrate/migrateUsers.pyc
>>/var/log/ipmigrate.log 2>&1


Change the time to the desired time interval.

NOTE:For information on scheduling time intervals for cron jobs,
see the article about Cron on Wikipedia.


Hello for those replying to this thread,

As per NNTP's reply to adjust the synchronization schedule when importing more than 10,000 users, I have adjusted my schedule to every 12 hours (as per below) but the CPU utilization is still at 190% (2 CPU's).

SHELL=/bin/sh
PATH=/usr/bin:/usr/sbin:/sbin:/bin:/usr/lib/news/bin
MAILTO=root
#
# check scripts in cron.hourly, cron.daily, cron.weekly, and cron.monthly
#
-*/15 * * * * root test -x /usr/lib/cron/run-crons && /usr/lib/cron/run-crons >/dev/null 2>&1

# Novell original schedule run iprint migrate every 8 minutes
# */8 * * * * root /usr/bin/python /opt/novell/iprintmobile/python/migrate/migrateUsers.pyc >> /var/log/ipmigrate.log 2>&1
#
# New schedule base on 10,000+ users
* */12 * * * root /usr/bin/python /opt/novell/iprintmobile/python/migrate/migrateUsers.pyc >> /var/log/ipmigrate.log 2>&1

I have also found that my /var/log/ipmigrate.log file had grown to over 8GB in size. I have since renamed this file in order to start a new file.
Problem 1: It has only imported 10K of the 17K users I have in AD
Problem 2: In the log file I am seeing a lot of the following, (for the sake of security I have modified the name, ou's and dc's)

Traceback (most recent call last):
File "/var/lib/jenkins/jobs/iprint-VA/workspace/iprint/scripts/migrate/target/build/mysqlreader.py", line 90, in QuerySpecificUser
ProgrammingError: (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'obrien suzanne,ou=sydney,dc=mycorp,dc=my,dc=domain,dc=name' and ldapGuid <> ''' at line 1")
Traceback (most recent call last):

Problem 3: In the log file I am seeing a lot of the following,
Failed to remove object [cn=isctest1,ou=users,dc=mycorp,dc=my,dc=domain,dc=name] from iprint directory

Problem 4: In the log file I am seeing a lot of the following,
Add User Added
Add User Added
Add User Added
Add User Added
Add User Added
But nothing seems to be added (still missing 7K users)

I had success importing with the Beta versions of the iPrint Appliance so configuring this v1 was a breeze. I am not sure if I have missed anything here.
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.