Arcpy multiprocessing arcpy.Select_analysis The Next CEO of Stack OverflowWhy Can't ArcPy...

Is a distribution that is normal, but highly skewed, considered Gaussian?

What is the difference between "hamstring tendon" and "common hamstring tendon"?

TikZ: How to fill area with a special pattern?

Is there a difference between "Fahrstuhl" and "Aufzug"?

Players Circumventing the limitations of Wish

Easy to read palindrome checker

Film where the government was corrupt with aliens, people sent to kill aliens are given rigged visors not showing the right aliens

In the "Harry Potter and the Order of the Phoenix" video game, what potion is used to sabotage Umbridge's speakers?

What CSS properties can the br tag have?

Why is information "lost" when it got into a black hole?

Airplane gently rocking its wings during whole flight

how one can write a nice vector parser, something that does pgfvecparse{A=B-C; D=E x F;}

Why is the US ranked as #45 in Press Freedom ratings, despite its extremely permissive free speech laws?

Scary film where a woman has vaginal teeth

Graph of the history of databases

Is it correct to say moon starry nights?

Reshaping json / reparing json inside shell script (remove trailing comma)

How did Beeri the Hittite come up with naming his daughter Yehudit?

vector calculus integration identity problem

Is there a way to save my career from absolute disaster?

Physiological effects of huge anime eyes

My ex-girlfriend uses my Apple ID to login to her iPad, do I have to give her my Apple ID password to reset it?

How to avoid supervisors with prejudiced views?

Is it ok to trim down a tube patch?



Arcpy multiprocessing arcpy.Select_analysis



The Next CEO of Stack OverflowWhy Can't ArcPy Search the Newly Created FeatureArcGIS Copy Features tool extremely slow when exporting to ArcSDE?Multiprocessing issues with ArcPySetting ArcPy environment variables with Python multiprocessing?Arcpy and multiprocessing not workingBatch intersect and multiprocessing with arcpyCombining python (parallel) multiprocessing toolbox with arcpyAccessing differing geodatabase schemas from arcpyarcpy and multiprocessing: switch workflow to shapefiles to avoid schemalocksMultiprocessing GALayerToRasters












0















I have the following script:



import arcpy
from arcpy import env
import datetime
import os


env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
dataFC = arcpy.ListFeatureClasses("","","Contours")
outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
query = "objectid > 0 AND objectid <= 200000 "

for fc in dataFC:
if fc == 'Contours':
output = outpath + os.sep + fc
arcpy.Select_analysis(fc, output+'200k', query)


Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.



What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.



How would I go about doing that?
I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.



Thanks!









share







New contributor




user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

























    0















    I have the following script:



    import arcpy
    from arcpy import env
    import datetime
    import os


    env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
    dataFC = arcpy.ListFeatureClasses("","","Contours")
    outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
    query = "objectid > 0 AND objectid <= 200000 "

    for fc in dataFC:
    if fc == 'Contours':
    output = outpath + os.sep + fc
    arcpy.Select_analysis(fc, output+'200k', query)


    Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.



    What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.



    How would I go about doing that?
    I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.



    Thanks!









    share







    New contributor




    user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.























      0












      0








      0








      I have the following script:



      import arcpy
      from arcpy import env
      import datetime
      import os


      env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
      dataFC = arcpy.ListFeatureClasses("","","Contours")
      outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
      query = "objectid > 0 AND objectid <= 200000 "

      for fc in dataFC:
      if fc == 'Contours':
      output = outpath + os.sep + fc
      arcpy.Select_analysis(fc, output+'200k', query)


      Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.



      What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.



      How would I go about doing that?
      I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.



      Thanks!









      share







      New contributor




      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.












      I have the following script:



      import arcpy
      from arcpy import env
      import datetime
      import os


      env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
      dataFC = arcpy.ListFeatureClasses("","","Contours")
      outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
      query = "objectid > 0 AND objectid <= 200000 "

      for fc in dataFC:
      if fc == 'Contours':
      output = outpath + os.sep + fc
      arcpy.Select_analysis(fc, output+'200k', query)


      Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.



      What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.



      How would I go about doing that?
      I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.



      Thanks!







      arcpy select parallel-processing





      share







      New contributor




      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.










      share







      New contributor




      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.








      share



      share






      New contributor




      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 4 mins ago









      user139485user139485

      61




      61




      New contributor




      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      user139485 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "79"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });






          user139485 is a new contributor. Be nice, and check out our Code of Conduct.










          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f317298%2farcpy-multiprocessing-arcpy-select-analysis%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          user139485 is a new contributor. Be nice, and check out our Code of Conduct.










          draft saved

          draft discarded


















          user139485 is a new contributor. Be nice, and check out our Code of Conduct.













          user139485 is a new contributor. Be nice, and check out our Code of Conduct.












          user139485 is a new contributor. Be nice, and check out our Code of Conduct.
















          Thanks for contributing an answer to Geographic Information Systems Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f317298%2farcpy-multiprocessing-arcpy-select-analysis%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Щит и меч (фильм) Содержание Названия серий | Сюжет |...

          is 'sed' thread safeWhat should someone know about using Python scripts in the shell?Nexenta bash script uses...

          Meter-Bus Содержание Параметры шины | Стандартизация |...