Announcement

Collapse
No announcement yet.
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Getting some errors when I try to use parallel

    use data/ONLYpafdta,clear
    capture program drop calc_paf
    program define calc_paf, rclass
    use data/ONLYpafdta,clear
    *version 17.0
    *syntax varlist [,if] [,in]
    *args ipdc hiv year agecat ipdoutc pop
    ***unser5
    bsample, cluster(idcode) idcluster(newid)
    *local j=1
    forval fred=1/20{
    forval j=1/3{
    **proportion
    proportion hiv_status if agecat1==`j' & !missing(ipd_outtcome) & _mi_m ==`fred'
    local prev_`fred'_`j'=round(r(table)[1,2],0.0001)
    ***negative binomial regression
    nbreg ipd_count hiv_status year if agecat1==`j' & missing(ipd_outtcome) & _mi_m ==`fred',exp(midyrpopdx) difficult technique(nr bhhh dfp bfgs) iter(500)
    local prevRR_`fred'_`j'=round(r(table)[1,1],0.0001)

    }

    }
    **proportion
    local prop_under5=(`prev_1_1'+`prev_2_1'+`prev_3_1'+`pre v_4_1'+`prev_5_1'+`prev_6_1'+`prev_7_1'+`prev_8_1' +`prev_9_1'+`prev_10_1'+`prev_11_1'+`prev_12_1' ///
    +`prev_13_1'+`prev_14_1'+`prev_15_1'+`prev_16_1'+` prev_17_1'+`prev_18_1'+`prev_19_1'+`prev_20_1')/20
    *ren prop_under5 under5prop

    local prop_5to14=(`prev_1_2'+`prev_2_2'+`prev_3_2'+`prev _4_2'+`prev_5_2'+`prev_6_2'+`prev_7_2'+`prev_8_2'+ `prev_9_2'+`prev_10_2'+`prev_11_2'+`prev_12_2' ///
    +`prev_13_2'+`prev_14_2'+`prev_15_2'+`prev_16_2'+` prev_17_2'+`prev_18_2'+`prev_19_2'+`prev_20_2')/20


    local prop_5Above=(`prev_1_3'+`prev_2_3'+`prev_3_3'+`pre v_4_3'+`prev_5_3'+`prev_6_3'+`prev_7_3'+`prev_8_3' +`prev_9_3'+`prev_10_3'+`prev_11_3'+`prev_12_3' ///
    +`prev_13_3'+`prev_14_3'+`prev_15_3'+`prev_16_3'+` prev_17_3'+`prev_18_3'+`prev_19_3'+`prev_20_3')/20

    ***relative risk
    local prop_under5RR=exp((`prevRR_1_1'+`prevRR_2_1'+`prev RR_3_1'+`prevRR_4_1'+`prevRR_5_1'+`prevRR_6_1'+`pr evRR_7_1'+`prevRR_8_1'+`prevRR_9_1'+`prevRR_10_1'+ `prevRR_11_1'+`prevRR_12_1' ///
    +`prevRR_13_1'+`prevRR_14_1'+`prevRR_15_1'+`prevRR _16_1'+`prevRR_17_1'+`prevRR_18_1'+`prevRR_19_1'+` prevRR_20_1')/20)
    *ren prop_under5RR RR_under5

    local prop_5to14RR=exp((`prevRR_1_2'+`prevRR_2_2'+`prevR R_3_2'+`prevRR_4_2'+`prevRR_5_2'+`prevRR_6_2'+`pre vRR_7_2'+`prevRR_8_2'+`prevRR_9_2'+`prevRR_10_2'+` prevRR_11_2'+`prevRR_12_2' ///
    +`prevRR_13_2'+`prevRR_14_2'+`prevRR_15_2'+`prevRR _16_2'+`prevRR_17_2'+`prevRR_18_2'+`prevRR_19_2'+` prevRR_20_2')/20)


    local prop_5AboveRR=exp((`prevRR_1_3'+`prevRR_2_3'+`prev RR_3_3'+`prevRR_4_3'+`prevRR_5_3'+`prevRR_6_3'+`pr evRR_7_3'+`prevRR_8_3'+`prevRR_9_3'+`prevRR_10_3'+ `prevRR_11_3'+`prevRR_12_3' ///
    +`prevRR_13_3'+`prevRR_14_3'+`prevRR_15_3'+`prevRR _16_3'+`prevRR_17_3'+`prevRR_18_3'+`prevRR_19_3'+` prevRR_20_3')/20)



    // Calculate PAF
    local paf =(`prop_under5'*(`prop_under5RR'-1))/(`prop_under5RR')
    return scalar pafunde5 = `paf'

    ***5to14
    local pafx =(`prop_5to14'*(`prop_5to14RR'-1))/(`prop_5to14RR')
    return scalar pafunde5to14 =`pafx'

    ***15 and above
    local pafxx =(`prop_5Above'*(`prop_5AboveRR'-1))/(`prop_5AboveRR')
    return scalar pafunde15plus=`pafxx'

    end
    **boot strap
    *bootstrap r(pafunde5), reps(1000) nodrop: calc_paf
    ***Amm just so interested in CI
    local seeds 123 456 789 101112
    parallel setclusters 4,statapath(/Applications/Stata/StataBE.app/Contents/MacOS/StataBE)
    parallel sim,expr(result =r(pafunde5)) reps(1000) seed(`seeds') dots: calc_paf

    Above is my code and the error is as below:

    use data/ONLYpafdta,clear
    capture program drop calc_paf
    program define calc_paf, rclass
    use data/ONLYpafdta,clear
    *version 17.0
    *syntax varlist [,if] [,in]
    *args ipdc hiv year agecat ipdoutc pop
    ***unser5
    bsample, cluster(idcode) idcluster(newid)
    *local j=1
    forval fred=1/20{
    forval j=1/3{
    **proportion
    proportion hiv_status if agecat1==`j' & !missing(ipd_outtcome) & _mi_m ==`fred'
    local prev_`fred'_`j'=round(r(table)[1,2],0.0001)
    ***negative binomial regression
    nbreg ipd_count hiv_status year if agecat1==`j' & missing(ipd_outtcome) & _mi_m ==`fred',exp(midyrpopdx) difficult technique(nr bhhh dfp bfgs) iter(500)
    local prevRR_`fred'_`j'=round(r(table)[1,1],0.0001)

    }

    }
    **proportion
    local prop_under5=(`prev_1_1'+`prev_2_1'+`prev_3_1'+`pre v_4_1'+`prev_5_1'+`prev_6_1'+`prev_7_1'+`prev_8_1' +`prev_9_1'+`prev_10_1'+`prev_11_1'+`prev_12_1' ///
    +`prev_13_1'+`prev_14_1'+`prev_15_1'+`prev_16_1'+` prev_17_1'+`prev_18_1'+`prev_19_1'+`prev_20_1')/20
    *ren prop_under5 under5prop

    local prop_5to14=(`prev_1_2'+`prev_2_2'+`prev_3_2'+`prev _4_2'+`prev_5_2'+`prev_6_2'+`prev_7_2'+`prev_8_2'+ `prev_9_2'+`prev_10_2'+`prev_11_2'+`prev_12_2' ///
    +`prev_13_2'+`prev_14_2'+`prev_15_2'+`prev_16_2'+` prev_17_2'+`prev_18_2'+`prev_19_2'+`prev_20_2')/20


    local prop_5Above=(`prev_1_3'+`prev_2_3'+`prev_3_3'+`pre v_4_3'+`prev_5_3'+`prev_6_3'+`prev_7_3'+`prev_8_3' +`prev_9_3'+`prev_10_3'+`prev_11_3'+`prev_12_3' ///
    +`prev_13_3'+`prev_14_3'+`prev_15_3'+`prev_16_3'+` prev_17_3'+`prev_18_3'+`prev_19_3'+`prev_20_3')/20

    ***relative risk
    local prop_under5RR=exp((`prevRR_1_1'+`prevRR_2_1'+`prev RR_3_1'+`prevRR_4_1'+`prevRR_5_1'+`prevRR_6_1'+`pr evRR_7_1'+`prevRR_8_1'+`prevRR_9_1'+`prevRR_10_1'+ `prevRR_11_1'+`prevRR_12_1' ///
    +`prevRR_13_1'+`prevRR_14_1'+`prevRR_15_1'+`prevRR _16_1'+`prevRR_17_1'+`prevRR_18_1'+`prevRR_19_1'+` prevRR_20_1')/20)
    *ren prop_under5RR RR_under5

    local prop_5to14RR=exp((`prevRR_1_2'+`prevRR_2_2'+`prevR R_3_2'+`prevRR_4_2'+`prevRR_5_2'+`prevRR_6_2'+`pre vRR_7_2'+`prevRR_8_2'+`prevRR_9_2'+`prevRR_10_2'+` prevRR_11_2'+`prevRR_12_2' ///
    +`prevRR_13_2'+`prevRR_14_2'+`prevRR_15_2'+`prevRR _16_2'+`prevRR_17_2'+`prevRR_18_2'+`prevRR_19_2'+` prevRR_20_2')/20)


    local prop_5AboveRR=exp((`prevRR_1_3'+`prevRR_2_3'+`prev RR_3_3'+`prevRR_4_3'+`prevRR_5_3'+`prevRR_6_3'+`pr evRR_7_3'+`prevRR_8_3'+`prevRR_9_3'+`prevRR_10_3'+ `prevRR_11_3'+`prevRR_12_3' ///
    +`prevRR_13_3'+`prevRR_14_3'+`prevRR_15_3'+`prevRR _16_3'+`prevRR_17_3'+`prevRR_18_3'+`prevRR_19_3'+` prevRR_20_3')/20)



    // Calculate PAF
    local paf =(`prop_under5'*(`prop_under5RR'-1))/(`prop_under5RR')
    return scalar pafunde5 = `paf'

    ***5to14
    local pafx =(`prop_5to14'*(`prop_5to14RR'-1))/(`prop_5to14RR')
    return scalar pafunde5to14 =`pafx'

    ***15 and above
    local pafxx =(`prop_5Above'*(`prop_5AboveRR'-1))/(`prop_5AboveRR')
    return scalar pafunde15plus=`pafxx'

    end
    **boot strap
    *bootstrap r(pafunde5), reps(1000) nodrop: calc_paf
    ***Amm just so interested in CI
    local seeds 123 456 789 101112
    parallel setclusters 4,statapath(/Applications/Stata/StataBE.app/Contents/MacOS/StataBE)
    parallel sim,expr(result =r(pafunde5)) reps(1000) seed(`seeds') dots: calc_paf

  • #2
    sorry the error is:
    . parallel sim,expr(result =r(pafunde5)) reps(1000) seed(`seeds') dots: calc_paf
    invalid 'AND'
    stata(): 3598 Stata returned error
    parallel_export_programs(): - function returned error
    parallel_write_do(): - function returned error
    <istmt>: - function returned error
    r(3598);

    end of do-file

    r(3598);

    Comment


    • #3
      I don't know how to include the whole dataset since I have I feeling trying this code require the whole dataset since we have to loop through all the 20 imputed datasets and by age category.Is there away to upload the data here?

      Comment


      • #4
        Still requesting ant help to solve this.my code is running without parallel but its taking forever.I need to utilise parallel.I don't understand why its refusing

        Comment


        • #5
          This looks like an unexpected internal error, meaning that there is probably nothing wrong with what you have done. I would contact the author for help.

          Comment


          • #6
            Dear Daniel I managed to make it run by apparently parallel did not want to use the directory "/Users/fodiwuor/Library/CloudStorage/OneDrive-KemriWellcomeTrust/fodiwuor/studies/AASRF_projects/CARRIAGE AND SYTEMATICREVIEW" because of AND in "CARRIAGE AND SYTEMATICREVIEW"

            Comment


            • #7
              Do you have a good expirience with parallel.I would like to give you a call if yes.Still have some tasks I want to use parallel on but I fear parallel may divide observations that I want to use in one place ton different clusters. my contact is +254706305628.

              Comment


              • #8
                Originally posted by Fredrick orwa View Post
                Do you have a good expirience with parallel.I would like to give you a call if yes.Still have some tasks I want to use parallel on but I fear parallel may divide observations that I want to use in one place ton different clusters..
                Sorry, I have never used parallel and I do not have the time to provide comprehensive individual consulting.

                Comment


                • #9
                  Frederick
                  easiest solution. Change the name of the folder, avoiding spaces

                  Comment

                  Working...
                  X