community.streamsets.com Open in urlscan Pro
2600:9000:211a:3600:a:186d:e7c0:93a1  Public Scan

Submitted URL: http://click.streamsets.com/NTM1LVRFQS02NTcAAAGGCQEle2QKDBIArm_gA83iWQcd_qwksDyB1HO74CvfH-yDF5gJGkZ7gFmWHo85SQVs4Hor77A=
Effective URL: https://community.streamsets.com/?mkt_tok=NTM1LVRFQS02NTcAAAGGCQEle_RH5NpLWR1Xw37Wuq7CWud3xePUTnhMaCQzj3yqBHDLNSucqGuyINMd7s52CU3...
Submission: On August 04 via api from US — Scanned from DE

Form analysis 4 forms found in the DOM

GET /search/index

<form method="get" action="/search/index">
  <div class="searchbox searchbox--large qa-search-area">
    <div class="searchbox__input algolia-search--forum qa-menu-search-input">
      <div class="search-and-filter-wrapper"><span>
          <div class="algolia-search-container" role="combobox" aria-haspopup="listbox" aria-labelledby="downshift-2-label">
            <div class="algolia-search-container--empty-input">
              <div class="search-box"><input aria-label="Search" type="search" placeholder="Search" autocomplete="off" autocorrect="off" autocapitalize="off" class="search-box__input" aria-autocomplete="list" aria-labelledby="downshift-2-label"
                  id="downshift-2-input"><button type="submit" aria-label="Enter" class="search-box__submit"><svg aria-hidden="true" width="16" height="16" class="" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg">
                    <path
                      d="M15.5 14H14.71L14.43 13.73C15.41 12.59 16 11.11 16 9.5C16 5.91 13.09 3 9.5 3C5.91 3 3 5.91 3 9.5C3 13.09 5.91 16 9.5 16C11.11 16 12.59 15.41 13.73 14.43L14 14.71V15.5L19 20.49L20.49 19L15.5 14ZM9.5 14C7.01 14 5 11.99 5 9.5C5 7.01 7.01 5 9.5 5C11.99 5 14 7.01 14 9.5C14 11.99 11.99 14 9.5 14Z"
                      fill="currentColor"></path>
                  </svg></button><button type="reset" aria-label="Clear search" class="search-box__reset" style="opacity: 0;"><svg aria-hidden="true" width="16" height="16" viewBox="0 0 16 16" fill="none" class="">
                    <path
                      d="M8.00065 1.33334C4.31398 1.33334 1.33398 4.31334 1.33398 8.00001C1.33398 11.6867 4.31398 14.6667 8.00065 14.6667C11.6873 14.6667 14.6673 11.6867 14.6673 8.00001C14.6673 4.31334 11.6873 1.33334 8.00065 1.33334ZM11.334 10.3933L10.394 11.3333L8.00065 8.94001L5.60732 11.3333L4.66732 10.3933L7.06065 8.00001L4.66732 5.60668L5.60732 4.66668L8.00065 7.06001L10.394 4.66668L11.334 5.60668L8.94065 8.00001L11.334 10.3933Z"
                      fill="currentColor"></path>
                  </svg></button></div>
            </div>
          </div>
        </span></div>
    </div>
  </div>
</form>

Name: registerPOST /member/register

<form name="register" method="post" action="/member/register" class="form js-ajax-form--registration" novalidate="novalidate">
  <div class="js-notification ">
    <div class="box box__pad is-hidden">
      <ul></ul>
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label required" for="register_user_username"> Username * </label>
    </div>
    <div class="second">
      <input type="text" id="register_user_username" name="register[user][username]" required="required">
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label required" for="register_user_email"> E-mail address * </label>
    </div>
    <div class="second">
      <input type="email" id="register_user_email" name="register[user][email]" required="required">
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label"> What I do... * </label>
    </div>
    <div class="second">
      <div id="register_customfield_9"><input type="radio" id="register_customfield_9_0" name="register[customfield][9]" value="data_leader"> <label for="register_customfield_9_0"> Data Leader </label><input type="radio" id="register_customfield_9_1"
          name="register[customfield][9]" value="data_architect"> <label for="register_customfield_9_1"> Data Architect </label><input type="radio" id="register_customfield_9_2" name="register[customfield][9]" value="data_engineer"> <label
          for="register_customfield_9_2"> Data Engineer </label><input type="radio" id="register_customfield_9_3" name="register[customfield][9]" value="data_scientist"> <label for="register_customfield_9_3"> Data Scientist </label><input
          type="radio" id="register_customfield_9_4" name="register[customfield][9]" value="other"> <label for="register_customfield_9_4"> Other </label></div>
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label" for="register_customfield_5"> Company * </label>
    </div>
    <div class="second">
      <input type="text" id="register_customfield_5" name="register[customfield][5]" data-minchar="" data-maxchar="1000" placeholder=""
        data-labels="{&quot;single&quot;:&quot;{n} character left&quot;,&quot;plural&quot;:&quot;{n} characters left&quot;}">
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label" for="register_customfield_10"> Country * </label>
    </div>
    <div class="second">
      <select id="register_customfield_10" name="register[customfield][10]" class="userProfileFieldSelect">
        <option value="">Please select</option>
        <option value="united_states">United States</option>
        <option value="canada">Canada</option>
        <option value="afghanistan">Afghanistan</option>
        <option value="albania">Albania</option>
        <option value="algeria">Algeria</option>
        <option value="andorra">Andorra</option>
        <option value="angola">Angola</option>
        <option value="anguilla">Anguilla</option>
        <option value="antigua_and_barbuda">Antigua and Barbuda</option>
        <option value="argentina">Argentina</option>
        <option value="armenia">Armenia</option>
        <option value="aruba">Aruba</option>
        <option value="australia">Australia</option>
        <option value="austria">Austria</option>
        <option value="azerbaijan">Azerbaijan</option>
        <option value="bahamas">Bahamas</option>
        <option value="bahrain">Bahrain</option>
        <option value="bangladesh">Bangladesh</option>
        <option value="barbados">Barbados</option>
        <option value="belgium">Belgium</option>
        <option value="belize">Belize</option>
        <option value="benin">Benin</option>
        <option value="bermuda">Bermuda</option>
        <option value="bhutan">Bhutan</option>
        <option value="bolivia">Bolivia</option>
        <option value="bosnia_and_herzegovina">Bosnia and Herzegovina</option>
        <option value="botswana">Botswana</option>
        <option value="brazil">Brazil</option>
        <option value="british_indian_ocean_territory">British Indian Ocean Territory</option>
        <option value="brunei">Brunei</option>
        <option value="bulgaria">Bulgaria</option>
        <option value="burkina">Burkina</option>
        <option value="burundi">Burundi</option>
        <option value="cambodia">Cambodia</option>
        <option value="cameroon">Cameroon</option>
        <option value="cape_verde">Cape Verde</option>
        <option value="cayman_islands">Cayman Islands</option>
        <option value="central_african_republic">Central African Republic</option>
        <option value="chad">Chad</option>
        <option value="chile">Chile</option>
        <option value="taiwan">Taiwan</option>
        <option value="colombia">Colombia</option>
        <option value="comoros">Comoros</option>
        <option value="congo">Congo</option>
        <option value="congo_(democratic_rep)">Congo (Democratic Rep)</option>
        <option value="cook_islands">Cook Islands</option>
        <option value="costa_rica">Costa Rica</option>
        <option value="cote_d'ivoire">Cote d'Ivoire</option>
        <option value="croatia">Croatia</option>
        <option value="curaçao">Curaçao</option>
        <option value="cyprus">Cyprus</option>
        <option value="czech_republic">Czech Republic</option>
        <option value="denmark">Denmark</option>
        <option value="djibouti">Djibouti</option>
        <option value="dominica">Dominica</option>
        <option value="dominican_republic">Dominican Republic</option>
        <option value="ecuador">Ecuador</option>
        <option value="egypt">Egypt</option>
        <option value="el_salvador">El Salvador</option>
        <option value="equatorial_guinea">Equatorial Guinea</option>
        <option value="eritrea">Eritrea</option>
        <option value="estonia">Estonia</option>
        <option value="ethiopia">Ethiopia</option>
        <option value="fiji">Fiji</option>
        <option value="finland">Finland</option>
        <option value="france">France</option>
        <option value="gabon">Gabon</option>
        <option value="gambia">Gambia</option>
        <option value="georgia">Georgia</option>
        <option value="germany">Germany</option>
        <option value="ghana">Ghana</option>
        <option value="greece">Greece</option>
        <option value="greenland">Greenland</option>
        <option value="grenada">Grenada</option>
        <option value="guadeloupe">Guadeloupe</option>
        <option value="guatemala">Guatemala</option>
        <option value="guernsey">Guernsey</option>
        <option value="guinea">Guinea</option>
        <option value="guinea-bissau">Guinea-Bissau</option>
        <option value="guyana">Guyana</option>
        <option value="haiti">Haiti</option>
        <option value="honduras">Honduras</option>
        <option value="hungary">Hungary</option>
        <option value="iceland">Iceland</option>
        <option value="india">India</option>
        <option value="indonesia">Indonesia</option>
        <option value="iraq">Iraq</option>
        <option value="ireland">Ireland</option>
        <option value="israel">Israel</option>
        <option value="italy">Italy</option>
        <option value="jamaica">Jamaica</option>
        <option value="japan">Japan</option>
        <option value="jordan">Jordan</option>
        <option value="kazakhstan">Kazakhstan</option>
        <option value="kenya">Kenya</option>
        <option value="kiribati">Kiribati</option>
        <option value="korea_south">Korea South</option>
        <option value="kuwait">Kuwait</option>
        <option value="kyrgyzstan">Kyrgyzstan</option>
        <option value="laos">Laos</option>
        <option value="latvia">Latvia</option>
        <option value="lebanon">Lebanon</option>
        <option value="lesotho">Lesotho</option>
        <option value="liberia">Liberia</option>
        <option value="libya">Libya</option>
        <option value="liechtenstein">Liechtenstein</option>
        <option value="lithuania">Lithuania</option>
        <option value="luxembourg">Luxembourg</option>
        <option value="macao">Macao</option>
        <option value="macedonia">Macedonia</option>
        <option value="madagascar">Madagascar</option>
        <option value="malawi">Malawi</option>
        <option value="malaysia">Malaysia</option>
        <option value="maldives">Maldives</option>
        <option value="mali">Mali</option>
        <option value="malta">Malta</option>
        <option value="mauritania">Mauritania</option>
        <option value="mauritius">Mauritius</option>
        <option value="mexico">Mexico</option>
        <option value="moldova">Moldova</option>
        <option value="monaco">Monaco</option>
        <option value="mongolia">Mongolia</option>
        <option value="montenegro">Montenegro</option>
        <option value="morocco">Morocco</option>
        <option value="mozambique">Mozambique</option>
        <option value="myanmar">Myanmar</option>
        <option value="namibia">Namibia</option>
        <option value="nauru">Nauru</option>
        <option value="nepal">Nepal</option>
        <option value="netherlands">Netherlands</option>
        <option value="new_caledonia">New Caledonia</option>
        <option value="new_zealand">New Zealand</option>
        <option value="nicaragua">Nicaragua</option>
        <option value="niger">Niger</option>
        <option value="nigeria">Nigeria</option>
        <option value="norway">Norway</option>
        <option value="oman">Oman</option>
        <option value="pakistan">Pakistan</option>
        <option value="panama">Panama</option>
        <option value="papua_new_guinea">Papua New Guinea</option>
        <option value="paraguay">Paraguay</option>
        <option value="peru">Peru</option>
        <option value="philippines">Philippines</option>
        <option value="poland">Poland</option>
        <option value="portugal">Portugal</option>
        <option value="qatar">Qatar</option>
        <option value="romania">Romania</option>
        <option value="rwanda">Rwanda</option>
        <option value="st_kitts_&amp;_nevis">St Kitts &amp; Nevis</option>
        <option value="st_lucia">St Lucia</option>
        <option value="saint_vincent_&amp;_the_grenadines">Saint Vincent &amp; the Grenadines</option>
        <option value="samoa">Samoa</option>
        <option value="san_marino">San Marino</option>
        <option value="sao_tome_&amp;_principe">Sao Tome &amp; Principe</option>
        <option value="saudi_arabia">Saudi Arabia</option>
        <option value="senegal">Senegal</option>
        <option value="serbia">Serbia</option>
        <option value="seychelles">Seychelles</option>
        <option value="sierra_leone">Sierra Leone</option>
        <option value="singapore">Singapore</option>
        <option value="slovakia">Slovakia</option>
        <option value="slovenia">Slovenia</option>
        <option value="solomon_islands">Solomon Islands</option>
        <option value="somalia">Somalia</option>
        <option value="south_africa">South Africa</option>
        <option value="south_sudan">South Sudan</option>
        <option value="spain">Spain</option>
        <option value="sri_lanka">Sri Lanka</option>
        <option value="sudan">Sudan</option>
        <option value="suriname">Suriname</option>
        <option value="swaziland">Swaziland</option>
        <option value="sweden">Sweden</option>
        <option value="switzerland">Switzerland</option>
        <option value="tajikistan">Tajikistan</option>
        <option value="tanzania">Tanzania</option>
        <option value="thailand">Thailand</option>
        <option value="togo">Togo</option>
        <option value="tonga">Tonga</option>
        <option value="trinidad_&amp;_tobago">Trinidad &amp; Tobago</option>
        <option value="tunisia">Tunisia</option>
        <option value="turkey">Turkey</option>
        <option value="turkmenistan">Turkmenistan</option>
        <option value="tuvalu">Tuvalu</option>
        <option value="uganda">Uganda</option>
        <option value="united_arab_emirates">United Arab Emirates</option>
        <option value="united_kingdom">United Kingdom</option>
        <option value="uruguay">Uruguay</option>
        <option value="uzbekistan">Uzbekistan</option>
        <option value="vanuatu">Vanuatu</option>
        <option value="venezuela">Venezuela</option>
        <option value="vietnam">Vietnam</option>
        <option value="yemen">Yemen</option>
        <option value="zambia">Zambia</option>
        <option value="zimbabwe">Zimbabwe</option>
      </select>
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label" for="register_customfield_3"> Zip Code * </label>
    </div>
    <div class="second">
      <input type="text" id="register_customfield_3" name="register[customfield][3]" data-minchar="" data-maxchar="1000" placeholder=""
        data-labels="{&quot;single&quot;:&quot;{n} character left&quot;,&quot;plural&quot;:&quot;{n} characters left&quot;}">
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label data-required="1" class="label required" for="register_user_password"> Password * </label>
    </div>
    <div class="second">
      <input type="password" id="register_user_password" name="register[user][password]" required="required">
    </div>
  </div>
  <div class="form__row">
    <div class="first choices--stacked fancyselect">
      <input type="checkbox" id="register_terms" name="register[terms]" required="required" value="1">
      <label for="register_terms" class="required"> I have read and Agree to the <a href="https://streamsets.com/legal/terms-of-service/">Website Terms of Service</a> and I have read and acknowledged the
        <a href="https://streamsets.com/privacy-policy/">Privacy Policy.</a>
      </label>
    </div>
  </div>
  <div class="email_repeat" style="display: none;">
    <div class="form__row">
      <div class="first">
        <label class="label" for="register_email_repeat"> loginBox.register.email_repeat </label>
      </div>
      <div class="second">
        <input type="text" id="register_email_repeat" name="register[email_repeat]">
      </div>
    </div>
  </div>
  <button type="submit" id="register_submit" name="register[submit]" class="btn btn--cta btn--full-width"> Agree &amp; Continue <div class="loader"></div></button>
  <input type="hidden" id="register_is_invite" name="register[is_invite]">
  <input type="hidden" id="register__token" name="register[_token]" value="i7s-wDxYh-dLNJvtTs3wL0Sege2oJpDFcKCTZJ7l0H4">
</form>

Name: loginPOST /member/login

<form name="login" method="post" action="/member/login" class="form js-ajax-form--login">
  <div class="js-notification">
    <div class="box box__pad is-hidden">
      <ul></ul>
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label class="label required" for="login_usernameOrEmail"> Username or Email </label>
    </div>
    <div class="second">
      <input type="text" id="login_usernameOrEmail" name="login[usernameOrEmail]" required="required">
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label class="label required" for="login_password"> Password </label>
    </div>
    <div class="second">
      <input type="password" id="login_password" name="login[password]" required="required">
    </div>
  </div>
  <div class="form__row">
    <div class="first choices--stacked fancyselect">
      <input type="checkbox" id="login_remember" name="login[remember]" value="1">
      <label for="login_remember"> Remember me </label>
    </div>
  </div>
  <button type="submit" id="login_submit" name="login[submit]" class="btn btn--cta btn--full-width"> Log in <div class="loader"></div></button>
  <div class="box__pad box--note box--blend">
    <a href="#" class="js-open-modal" data-modal="forgot" tabindex="-1">Forgot password?</a>
  </div>
  <input type="hidden" id="login__token" name="login[_token]" value="QCWbB3YONhQ2oOQo9XH5bAarYLjU7z-cNoTjr9Wa4l8">
</form>

Name: forgotPasswordPOST /member/forgotPassword

<form name="forgotPassword" method="post" action="/member/forgotPassword" class="form js-ajax-form--forgot" id="form--forgot__1378564536">
  <div class="js-notification">
    <div class="box box__pad is-hidden">
      <ul></ul>
    </div>
  </div>
  <div class="form__row">
    <div class="first">
      <label class="label required" for="forgotPassword_username"> Username or e-mail </label>
    </div>
    <div class="second">
      <input type="text" id="forgotPassword_username" name="forgotPassword[username]" required="required">
    </div>
  </div>
  <div class="form-row first">
    <button type="submit" id="forgotPassword_submit" name="forgotPassword[submit]" class="btn btn--cta qa-submit-button"> Send <div class="loader"></div></button>
    <a href="#" class="group__item end js-open-modal qa-forgot-password-overview-link" data-modal="login">Back to overview</a>
  </div>
  <input type="hidden" id="forgotPassword__token" name="forgotPassword[_token]" value="bvx6_CB-JjEuSpgsPteqeXDnjWKFZotVM1puEbsZX5I">
</form>

Text Content

COOKIE POLICY

We use cookies to enhance and personalize your experience. If you accept you
agree to our full cookie policy. Learn more about our cookies.

Accept cookies Deny all
Cookie settings
×


COOKIE SETTINGS


We use 3 different kinds of cookies. You can choose which cookies you want to
accept. We need basic cookies to make this site work, therefore these are the
minimum you can select. Learn more about our cookies.


Basic
Functional

Normal
Functional + analytics

Complete
Functional + analytics + social media + embedded videos

Accept cookies




 * Community
    * 
    * * Home
      * Recently active topics
      * Unanswered questions
      * Welcome
      * Welcome Guide20
      * Events & Webinars3
      * Community Newsletter11
      * Community Articles17
      * Show us your Pipelines26
      * Platform Q&A
      * Got a Question?358
      * Share your Best Practices11
      * StreamSets Academy13

 * Knowledge Base
    * 
    * * Knowledge base
      * StreamSets DataOps Platform
      * How To27
      * Best Practice 9
      * FAQ9
      * Common Issues31
      * Advanced Debugging5
      * Technical Service Bulletin8
      * Troubleshooting83
      * StreamSets 3.x
      * How To102
      * Best Practice127
      * FAQ34
      * Common Issues142
      * Advanced Debugging7
      * Technical Service Bulletin14

 * Groups
 * StreamSets Live
 * Write for Us



 * Create topic
   Login/Register




HI 👋 WELCOME TO THE STREAMSETS COMMUNITY


 * 1,067 Topics
 * 964 Replies
 * 716 Members

Recently online

R




 * Recently active
 * Help others
 * Categories

M

mstoffelRoadie
asked in Got a Question?

ERROR ON KAFKA CONSUMER


Hi,   I try to combine a datacollector and a transformer pipeline (due to the
missing parquet s3 support in datacollector). I read data from a Postgres db and
publish it to Kafka using the datacollector. I have a Kafka connection that I
want to use for both pipelines. Pushing Data to Kafka works but when I run the
transfom pipeline (using the same connection) I get the following error:  
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in
stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID
0, 53f742dd118a, executor driver): java.lang.NoSuchMethodError: ‘void
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.setEvictionPolicy(org.apache.commons.pool2.impl.EvictionPolicy)'
at
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.init(InternalKafkaConsumerPool.scala:191)
at
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.<init>(InternalKafkaConsumerPool.scala:162

05

52 minutes ago
Mike ArovRoadie
asked in Got a Question?

KAFKA CONSUMER IN TRANSFORMER THROWS JAVA.LANG.NOCLASSDEFFOUNDERROR


Hello, could you please help me out? In Transformer pipelines adding a Kafka
consumer throws java.lang.NoClassDefFoundError: Could not initialize class
org.apache.spark.sql.kafka010.consumer.KafkaDataConsumer$ The same connection
works fine with Data Collector. I am using local Spark in docker  Thanks!

05

56 minutes ago
A

andalvFan
asked in Got a Question?

HAS ANYONE USED JDBC PRODUCER TO CONNECT TO ORACLE ADW AUTONOMOUS DATA
WAREHOUSE?


I would like to stream data from an API and write the output to Oracle
autonomous data warehouse (ADW). Anyone else have experience doing this?    

00
A

3 hours ago
A

andalvFan
asked in Got a Question?

JAVA.LANG.NOCLASSDEFFOUNDERROR: ORG/APACHE/COMMONS/LANG3/STRINGUTILS


My JDBC producer stage is giving the error  java.lang.NoClassDefFoundError:
org/apache/commons/lang3/StringUtils   Has anyone had a similar issue before?

00
A

3 hours ago
L

levanyeFan
asked in Got a Question?

RUNNING ERROR PIPELINE COULDN`T FORCE STOP


  Running Error pipeline couldn`t stop, when I click the button of force stop,
nothing happened, what should i do?

27

12 hours ago
C

collidFan
asked in Got a Question?

RESTFUL API - RETURN JOBS FOR ALL GIVEN JOB IDS


Hi, does anyone have a working example of how to use the RESTful API, to POST
with the following URL /jobrunner/rest/v1/jobs/status and collect status data
back on multiple Job IDs ? I cannot seem to figure out how to get the body of
the request correctly. Thanks 

02
C

1 day ago
N_aliRoadie
asked in Got a Question?

PREVIEW DOESN'T SHOW THE RECORDS DATA.


Hello , i created a pipeline and it runs without errors , the output is as
expected which is 2777 records however when i run preview it shows no data
records except for the one in the screenshot below .and i couldn’t know why this
happens .   

04

1 day ago
mblahayRoadie
asked in Got a Question?

HOW DOES THE JDBC LOOKUP CACHE WORK?


The JDBC Lookup documentation explains how to configure the cache and how the
eviction works, but there is no discussion about how the cache actually works.
Is the query being evaluated and then hashed, with the hash value being used as
a key? or is something else happening?

01

1 day ago
P

PriyaFan
asked in Got a Question?

SAMPLE JAVA SCRIPT ORIGIN PIPELINE


  While i try to run any java script code (hello world) in java script scripting
origin , i am facing below error.  Also if any one had done sample java script
pipeline please share   please could any one help me with this.  

01

2 days ago
M

mstoffelRoadie
asked in Got a Question?

DELETE S3 OBJECT


Hi experts,   is it possible to delete objects from an s3 bucket using a
DataCollector Pipeline? Didn't find anything…   Thanks,   Marco

03
M

2 days ago
Show more activity
M

mstoffelRoadie
asked in Got a Question?

ERROR ON KAFKA CONSUMER


Hi,   I try to combine a datacollector and a transformer pipeline (due to the
missing parquet s3 support in datacollector). I read data from a Postgres db and
publish it to Kafka using the datacollector. I have a Kafka connection that I
want to use for both pipelines. Pushing Data to Kafka works but when I run the
transfom pipeline (using the same connection) I get the following error:  
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in
stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID
0, 53f742dd118a, executor driver): java.lang.NoSuchMethodError: ‘void
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.setEvictionPolicy(org.apache.commons.pool2.impl.EvictionPolicy)'
at
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.init(InternalKafkaConsumerPool.scala:191)
at
org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.<init>(InternalKafkaConsumerPool.scala:162

05

52 minutes ago
A

andalvFan
asked in Got a Question?

HAS ANYONE USED JDBC PRODUCER TO CONNECT TO ORACLE ADW AUTONOMOUS DATA
WAREHOUSE?


I would like to stream data from an API and write the output to Oracle
autonomous data warehouse (ADW). Anyone else have experience doing this?    

00
A

3 hours ago
A

andalvFan
asked in Got a Question?

JAVA.LANG.NOCLASSDEFFOUNDERROR: ORG/APACHE/COMMONS/LANG3/STRINGUTILS


My JDBC producer stage is giving the error  java.lang.NoClassDefFoundError:
org/apache/commons/lang3/StringUtils   Has anyone had a similar issue before?

00
A

3 hours ago
N_aliRoadie
asked in Got a Question?

PREVIEW DOESN'T SHOW THE RECORDS DATA.


Hello , i created a pipeline and it runs without errors , the output is as
expected which is 2777 records however when i run preview it shows no data
records except for the one in the screenshot below .and i couldn’t know why this
happens .   

04

1 day ago
mblahayRoadie
asked in Got a Question?

HOW DOES THE JDBC LOOKUP CACHE WORK?


The JDBC Lookup documentation explains how to configure the cache and how the
eviction works, but there is no discussion about how the cache actually works.
Is the query being evaluated and then hashed, with the hash value being used as
a key? or is something else happening?

01

1 day ago
P

PriyaFan
asked in Got a Question?

SAMPLE JAVA SCRIPT ORIGIN PIPELINE


  While i try to run any java script code (hello world) in java script scripting
origin , i am facing below error.  Also if any one had done sample java script
pipeline please share   please could any one help me with this.  

01

2 days ago
M

mstoffelRoadie
asked in Got a Question?

DELETE S3 OBJECT


Hi experts,   is it possible to delete objects from an s3 bucket using a
DataCollector Pipeline? Didn't find anything…   Thanks,   Marco

03
M

2 days ago
ravikumarFan
asked in Got a Question?

PROTOCOLS FOR INFORMATICA ARCHITECTURE


Before I can gain VPN access to run Informatica from home, I need to identify
all the protocols Informatica uses for an ETL job to run. I found that it uses a
native protocol for the repository, source, and target databases (so sqlnet for
Oracle). I also know that I'll need to identify all protocols that could
potentially be used to extract data from non-RDBMS sources (such as ftp). But,
what protocol would be used to connect to the server to run the job? Are there
any other protocols I'd need to be aware of that it might use as part of the
whole process of opening up Designer, creating a job, and running it?

01

2 days ago
N_aliRoadie
asked in Community Articles

AGGREGATE THE RECORDS INTO A SINGLE ARRAY OF OBJECTS


I have some json objects that looks as follows  and i want them to be all merged
in an array like :data: [ { nstaskid: “...”, awb: “….” }, { nstaskid: “...”,
awb: “….” }, ]   i tried to use javascript evalutor , loop over the records and
push them in an array and write this record array , but it didn’t work. Can you
please help me with that .

08

2 days ago
C

cruaineFan
asked in Got a Question?

WHY HASN'T MY AMAZON EC2 DEPLOYMENT CREATED A DATA COLLECTOR ENGINE?


I've followed the StreamSets documentation to create an AWS Environment and then
an Amazon EC2 Deployment, for a single Data Collector engine. I activated the
deployment and can view the provisioned EC2 instance within my AWS
account. However, in Control Hub, when I navigate to ‘Engines in Deployment’, it
has said ‘No Engines Found’, even when the deployment has been active for > 2.5
hrs. I’ve tried restarting the deployment but this didn’t help. Environment
config AWS region: eu-west-2Credential Type: Cross-Account Role Deployment
config Deployment Type: Amazon EC2Engine for Deployment: Data Collector
5.1.0Engine Instances: tried 1, then 2EC2 Instance Type: c4.large Deployment
Event Log Aug 1, 2022, 2:34:57 PM    INFO        Finished creating stackAug 1,
2022, 2:33:25 PM    INFO        Creating stackAug 1, 2022, 2:33:24 PM    INFO  
     Created SSM Parameter Token
StreamSets-Deployment-Token-******************************************************************************Aug
1, 202

01
C

3 days ago
Show more activity


WELCOME

Welcome to the StreamSets Community


WELCOME GUIDE

 * 20 topics
 * 10 Replies


EVENTS & WEBINARS

 * 3 topics
 * 0 Replies


COMMUNITY NEWSLETTER

 * 11 topics
 * 6 Replies


COMMUNITY ARTICLES

 * 17 topics
 * 17 Replies


SHOW US YOUR PIPELINES

 * 26 topics
 * 12 Replies


PLATFORM Q&A

Get inspired and gain all the knowledge you need


GOT A QUESTION?

 * 358 topics
 * 831 Replies


SHARE YOUR BEST PRACTICES

 * 11 topics
 * 8 Replies


STREAMSETS ACADEMY

 * 13 topics
 * 37 Replies




COMMUNITY LEADERBOARD

 * Week
 * All time

1
N_ali

41 points

41 points

2
Bikram

37 points

37 points

3
A

andalv

30 points

30 points

Show full leaderboard
1
Dash

2295 points

2295 points

2
S

Srinivasan Sankar

787 points

787 points

3
Bikram

470 points

470 points

Show full leaderboard


EVENTS CALENDAR






BADGE WINNERS

 * Bikramhas earned the badge Community Champion 🏅
 * Bikramhas earned the badge Eager to help

Show all badges


SOURCES AND DESTINATIONS PODCAST

Sources and Destinations · Episodes


POPULAR TAGS

 * Data Collector Engine
 * Pipeline
 * Control Hub
 * StreamSets DataOps Platform
 * JDBC


STREAMSETS EMPLOYEE LEADERBOARD

 * Week
 * All time

1
Pradeep

38 points

38 points

2
XavierV

36 points

36 points

3
Giuseppe Mura

35 points

35 points

4
rvlozano

15 points

15 points

5
Rishi

11 points

11 points

1
AkshayJadhav

5737 points

5737 points

2
Drew Kreiger

3558 points

3558 points

3
Rishi

1195 points

1195 points

4
Sami

947 points

947 points

5
dima

835 points

835 points




NEED MORE HELP?


DATAOPS PLATFORM DOCS

Learn how to make the most of StreamSets with user guides and tutorials


STREAMSETS ACADEMY

Get StreamSets certified to expand your skills and accelerate your success.


CONTACT SUPPORT

Contact our support team and we'll be happy to help you get up and running!


Powered by inSided
Terms & ConditionsCookie settings
Try StreamSets for free!


SIGN UP

Already have an account? Login

SOCIAL LOGIN

Google Login

or
Username *

E-mail address *

What I do... *
Data Leader Data Architect Data Engineer Data Scientist Other
Company *

Country *
Please selectUnited
StatesCanadaAfghanistanAlbaniaAlgeriaAndorraAngolaAnguillaAntigua and
BarbudaArgentinaArmeniaArubaAustraliaAustriaAzerbaijanBahamasBahrainBangladeshBarbadosBelgiumBelizeBeninBermudaBhutanBoliviaBosnia
and HerzegovinaBotswanaBrazilBritish Indian Ocean
TerritoryBruneiBulgariaBurkinaBurundiCambodiaCameroonCape VerdeCayman
IslandsCentral African RepublicChadChileTaiwanColombiaComorosCongoCongo
(Democratic Rep)Cook IslandsCosta RicaCote d'IvoireCroatiaCuraçaoCyprusCzech
RepublicDenmarkDjiboutiDominicaDominican RepublicEcuadorEgyptEl
SalvadorEquatorial
GuineaEritreaEstoniaEthiopiaFijiFinlandFranceGabonGambiaGeorgiaGermanyGhanaGreeceGreenlandGrenadaGuadeloupeGuatemalaGuernseyGuineaGuinea-BissauGuyanaHaitiHondurasHungaryIcelandIndiaIndonesiaIraqIrelandIsraelItalyJamaicaJapanJordanKazakhstanKenyaKiribatiKorea
SouthKuwaitKyrgyzstanLaosLatviaLebanonLesothoLiberiaLibyaLiechtensteinLithuaniaLuxembourgMacaoMacedoniaMadagascarMalawiMalaysiaMaldivesMaliMaltaMauritaniaMauritiusMexicoMoldovaMonacoMongoliaMontenegroMoroccoMozambiqueMyanmarNamibiaNauruNepalNetherlandsNew
CaledoniaNew ZealandNicaraguaNigerNigeriaNorwayOmanPakistanPanamaPapua New
GuineaParaguayPeruPhilippinesPolandPortugalQatarRomaniaRwandaSt Kitts & NevisSt
LuciaSaint Vincent & the GrenadinesSamoaSan MarinoSao Tome & PrincipeSaudi
ArabiaSenegalSerbiaSeychellesSierra LeoneSingaporeSlovakiaSloveniaSolomon
IslandsSomaliaSouth AfricaSouth SudanSpainSri
LankaSudanSurinameSwazilandSwedenSwitzerlandTajikistanTanzaniaThailandTogoTongaTrinidad
& TobagoTunisiaTurkeyTurkmenistanTuvaluUgandaUnited Arab EmiratesUnited
KingdomUruguayUzbekistanVanuatuVenezuelaVietnamYemenZambiaZimbabwe
Zip Code *

Password *

I have read and Agree to the Website Terms of Service and I have read and
acknowledged the Privacy Policy.
loginBox.register.email_repeat

Agree & Continue



LOGIN TO THE COMMUNITY

No account yet? Create an account

SOCIAL LOGIN

Google Login

or
Username or Email

Password

Remember me
Log in

Forgot password?

Enter your username or e-mail address. We'll send you an e-mail with
instructions to reset your password.

Username or e-mail

Send

Back to overview


SCANNING FILE FOR VIRUSES.

Sorry, we're still checking this file's contents to make sure it's safe to
download. Please try again in a few minutes.

OK


THIS FILE CANNOT BE DOWNLOADED

Sorry, our virus scanner detected that this file isn't safe to download.

OK


Feedback×