PLUGIN-1137 : Make Page Size configurable #3
Conversation
|
@sgarg-CS Do we need this change as , if Servicenow is slow it is taking same time irrespective of the batch size as confirmed in the last call where poojan was running the postman |
|
@prashantcloudsufi This feature doesn't make or break any existing functionality. It provides the user the flexibility to configure the number of records to be fetched in one batch from the UI at the design time itself or it can also be set as Macro and provided a value at the run time. It's an add-on that provides more control to the user running the pipeline. In terms of improving the performance, we do not have the results at the moment as to how much more or less time the pipeline would take when run with lesser or greater page size. A guide on the Informatica website recommends having the batch size based on the data volume to improve the performance when data is read from ServiceNow. This feature will be useful here as the user can configure the size as per his requirement. In case, this feature is not a part of this release, it could be considered as an enhancement for the future. |
|
Agree
…On Fri, Mar 11, 2022 at 8:41 AM Sanchit Garg ***@***.***> wrote:
@prashantcloudsufi <https://github.com/prashantcloudsufi> This feature
doesn't make or break any existing functionality. It provides the user the
flexibility to configure the number of records to be fetched in one batch
from the UI at the design time itself or it can also be set as Macro and
provided a value at the run time. It's an add-on that provides more control
to the user running the pipeline.
In terms of improving the performance, we do not have the results at the
moment as to how much more or less time the pipeline would take when run
with lesser or greater page size. A guide
<https://docs.informatica.com/integration-cloud/cloud-data-integration-connectors/h2l/1401-performance-tuning-guidelines-for-servicenow-connector-in-i/performance-tuning-guidelines-for-servicenow-connector-in-inform/performance-tuning-parameters/tune-the-batch-size-for-servicenow-sources.html>
on the Informatica website recommends having the batch size based on the
data volume to improve the performance when data is read from ServiceNow.
This feature will be useful here as the user can configure the size as per
his requirement.
In case, this feature is not a part of this release, it could be
considered as an enhancement for the future.
—
Reply to this email directly, view it on GitHub
<#3 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/APFBPAX7O3SJ7FYAXDX2OBTU7NZSXANCNFSM5QNK6BAQ>
.
Triage notifications on the go with GitHub Mobile for iOS
<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
or Android
<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
DISCLAIMER:The entire content of this email message is confidential. This
also applies to any files attached to it. This email is intended for an
individual or entity to whom they are addressed. In case you are not the
addressee of this email, and you have received it in error, immediately
contact the system manager. The information in this email is very
sensitive, and it is intended for the specific addressee. This email should
not be disseminated, distributed or copied. If you have received this email
and it was not for you, make sure to immediately notify the sender by email
and afterwards delete this email from your system. Disclosing, copying,
distributing, or taking any action in reliance to the email content is
strictly prohibited. Consider yourself notified.
|
PLUGIN-1137
This PR has been raised for internal review to be done by the CLOUDSUFI team members.
Please leave a comment here when you've reviewed all the changes in this PR.